Ideas – Mind the Gap

Categories

All (7)

Cloud Computing (1)

Data Analysis (1)

LLM (3)

Lit. Review (2)

NLP (3)

Policy (1)

WebDev (2)

[![](https://img.shields.io/endpoint?url=https%3A%2F%2Fhits.dwyl.com%2Fanrath%2Fblog_llm_plateau_final.json&show=unique&style=flat-square&label=Views&color=orange)]() (1)

[![](https://img.shields.io/endpoint?url=https%3A%2F%2Fhits.dwyl.com%2Fanrath%2Fblog_money-and-politics.json&show=unique&style=flat-square&label=Views&color=orange)]() (1)

[![](https://img.shields.io/endpoint?url=https%3A%2F%2Fhits.dwyl.com%2Fanrath%2Fblog_optimizing-payload.json&show=unique&style=flat-square&label=Views&color=orange)]() (1)

[![](https://img.shields.io/endpoint?url=https%3A%2F%2Fhits.dwyl.com%2Fanrath%2Fblog_small-language-models.json&show=unique&style=flat-square&label=Views&color=orange)]() (1)

[![](https://img.shields.io/endpoint?url=https%3A%2F%2Fhits.dwyl.com%2Fanrath%2Fblog_towards-monosemanticity.json&show=unique&style=flat-square&label=Views&color=orange)]() (1)

[![](https://img.shields.io/endpoint?url=https%3A%2F%2Fhits.dwyl.com%2Fanrath%2Fblog_video-games.json&show=unique&style=flat-square&label=Views&color=orange)]() (1)

[![](https://img.shields.io/endpoint?url=https%3A%2F%2Fhits.dwyl.com%2Fanrath%2Fblog_website-revamp.json&show=unique&style=flat-square&label=Views&color=orange)]() (1)

creativity (1)

design (2)

market-overview (1)

research (1)

Money and Politics in US House of Representatives Elections

I analyze the relationship between political spending and election results for US House of Representatives races from 2012-2020.

The Large World of Small(er) Language Models

I explore Small(er) Language Models, examining the techniques and innovations that make these models more efficient than their larger counterparts.

An Unexpected DNS Error

Optimizing payload with serverless deployments of a NextJS website on Vercel.

Why Game Design is Hard

An analysis of the business and technological challenges of game design which generalizes to other customer-focused businesses.

Langage Model Performance Plateaus. What’s next?

A look at trends in language model performance, pealing back technical details, and suggesting future opportunities.

Website Redesign

My process and learnings from redesigning my website.

Extending “Towards Monosemanticity”

Mechanistic interpretability by applying dictionary learning to Distill-GPT-2.