Semantics of Simple Programming Languages

I am reading about Semantics of Programming Languages and here is an attempt to code Racket to parse and interpret toy languages. More details will be added. The code here is not the final version but it compiles. It shows the progress made as I learn the nuances of Racket and types.

Read More

BTree Variants

Whenever I code Data structures like BTree,LSM etc. in OCaml I read SML,Rust or C++ code. The code I read is in a repo. that implements a caching layer or DBs like https://rethinkdb.com. I don’t find any direct OCaml references. So I ported this Haskell two-three tree by http://matthew.brecknell.net/post/btree-gadt/…. Moreover since I am learning it is hard to identify succinct functional code as some examples seem to be imperative.

Read More

Probabilistic and other Data Structures

tl;dr

  1. The code will be gradually improved and be committed to git finally.
  2. Performance considerations are not paramount here.
  3. The language is OCaml and it is imperative even though I will attempt to use functional Data structures.
  4. The repository is this
Read More

Llama Architecture(GPT)

tl;dr

  1. The architecture is described in Llama: Open and Efficient Foundation Language Models
  2. The code is ported from PyTorch to TensorFlow 2.x using various references. (e.g) https://nn.labml.ai/transformers/rope/index.html TensorFlow is very verbose and sometimes it poses difficulties as every line of PyTorch has to be ported.
  3. In very few cases the code can be directly ported with minimal changes. But this situation isn’t common.
  4. The math supporting the algorithm is only partially understood. There are several research papers to read.
  5. The RoPE embeddings and attention need more insight and explanation.In fact each section will need multiple diagrams and descriptions.
Read More

Learning Coq(Work in Progress)

I started dabbling in Programs and proofs recently by using Spacemacs and its Coq layer. Since I didn’t study this subject before I start by setting up and using the tools.

Read More

TensorFlow Recipes

As part of my effort to engage with the Open-source community I started answering Stackoverflow questions. I started by asking a few decent questions and then answered some of my own questions and accepted them. Gradually I understood that this community site is not only about answering but also asking good questions that others can answer.

Read More

Joy of OCaml - Part III

At this time this article is quite unwieldy and contains hundreds of lines of code without proper explanation. It has to be split up , edited and published as another series. Moreover I learnt more about how to code a functional language by consulting some experts. I will edit it in due course.

Read More

Joy of OCaml - Part I

Many programming problems lend themselves easily to solutions based on Functional Programming languages. It is not hard to convince ourselves of this after coding a Language like OCaml or Haskell.

Read More