Blogs and Posts

Generating Structured Outputs from LLMs

An overview of popular techniques to confine LLMs’ output to a predefined schema

Structured Output

Today, the most common interface for interacting with LLMs is through the classic chat UI found in ChatGPT, Gemini, or DeepSeek. The interface is quite simple, where the…

What is LoRa and when should it be used?

A look at a memory and storage efficient technique to fine-tune large models

With the recent advancements in LLMs, the size of models continues to grow, and fine-tuning models is becoming increasingly expensive. The rise of this issue led to an…

Implementing the Word2Vec Paper

A look at a classic NLP paper

Paper Implementation

In 2013, the Efficient Estimation of Word Representations in Vector Space paper was released introducing two new model architectures for generating vector representations…

Origins of The Cross-Entropy Loss Function

Gaining Intuition on the Popular Loss Function

The cross-entropy loss function is one of the most widely used loss functions in deep learning, particularly for classification tasks. I’ve used it before and understood the…

Using BERT to predict disaster Tweets

In 2019, Kaggle hosted the Natural Language Processing with Disaster Tweets competition. It was made for contestants to test their ability to build a machine learning model…

Building a Receipt Understanding Model

Fine-tuning LayoutLMv3 on the SROIE dataset

document understanding

image processing

Receipts are a common way to store information about the items purchased. They are used by customers to keep track of their expenses and by businesses to keep track of their…

Exploring Egypt’s College Admission Test

2022 Sanawya Amma Results Analysis

data visualization

Every year, high school seniors rise to one of their largest life challenges: College Admission. Each country has its system for college admission shaping the career journey…

2024 Olympic Medalists

A Nation-Level Analysis

data visualization

On July 26, 2024, the Paris 2024 Olympics commenced, sending lights of hope into the hearts of every athlete. As the world watched in anticipation, dreams were forged and…