*"This is a 1 hour general-audience introduction to Large Language Models: the core technical component behind systems like ChatGPT, Claude, and Bard. What they are, where they are headed, comparisons and analogies to present-day operating systems, and some of the security-related challenges of this new computing paradigm."*

Andrej Karpathy - Intro to Large Language Models [Video]

Hi I'm Jeremy. I'm building this site because I'm not satisfied with other online community type websites and their lack of innovation (see the /about page). The goal is to make a superior, more open, and more decentralized online community.

The site is still in early stages in active development (see the dev masterthread here: https://zsync.xyz/p/zsync-dev-update-masterthread)

Join us if this sounds interesting! Feel free to send me any feedback or reach out directly!

*"While self-correction has shown promise in improving LLM outputs in terms of style and quality (e.g. Chen et al., 2023; Madaan et al., 2023), recent attempts to self-correct logical or reasoning errors often cause correct answers to become incorrect, resulting in worse performances overall (Huang et al., 2023). In this paper, we break down the self-correction process into two core components: mistake finding and output correction. For mistake finding, we release BIG-Bench Mistake, a dataset of logical mistakes in Chain-of-Thought reasoning traces. We provide benchmark numbers for several state-of-the-art LLMs, and demonstrate that LLMs generally struggle with finding logical mistakes. For output correction, we propose a backtracking method which provides large improvements when given information on mistake location. We construe backtracking as a lightweight alternative to reinforcement learning methods, and show that it remains effective with a reward model at 60-70% accuracy."*

LLMs cannot find reasoning errors, but can correct them

Show HN: <https://news.ycombinator.com/item?id=38285228>

*"I built a simple React/Python app that takes screenshots of websites and converts them to clean HTML/Tailwind code.*

*It uses GPT-4 Vision to generate the code, and DALL-E 3 to create placeholder images.*

*To run it, all you need is an OpenAI key with GPT vision access.*

*I’m quite pleased with how well it works most of the time. Sometimes, the image generations can be hilariously off. See here for a replica of Taylor Swift’s Instagram page: [https://streamable.com/70gow1](https://streamable.com/70gow1) I initially had a hard time getting it to work on full page screenshots. GPT4 would code up the first couple of sections and then, get lazy and output placeholder comments for the rest of the page. With some prompt engineering, full page screenshots work a whole lot better now. It’s great for landing pages."*

Convert any screenshot into clean HTML code using GPT Vision (OSS tool)

Trump's Truth Social has lost $73 million in less than 2 years, new filing says                

October 1, 2003 reading text on my Nokia 3390

What I believe to be one of the most underrated features of LLMs is the ability to convert imprecise human text into code.

In the past, writing a computer program required writing code - aka writing text in a very specific, tedious way such that it can be understood by a computer. A single erroneous character will crash an entire program. Writing code is difficult and tedious enough that it is a professional career that tends to require some degree of study (eg. 4 year CS degree, coding bootcamp), and the job can command annual compensation packages from $100k-$1m+/yr.

LLMs for the first time enable writing programs through natural language, ie. without writing code.

What this will do is make it dramatically easier to create computer programs. The technological jump is the equivalent of trying to talk to someone in Icelandic in 1989 (assuming you don't speak Icelandic), and then suddenly being given access to a modern smartphone with Google Translate.

Some implications:

- Anyone will be able to easily create or update computer programs
- Computer programs will easily be able to create computer programs
- Coding for the first time in history will just be done by regular human language instructions that any non-technical person can write. A disgruntled customer or product manager will simply be able to create a bug report or feature request, and an AI agent will immediately be able to take that and update the codebase (eg. submitting a pull request after testing and code reviewing its own work)
- Programming languages will become unimportant, because any language will easily be able to be translated into any other
- Coding will be commoditized

The human programmer is the translation layer between the human and the machine, and AI is automating that work away, just like it's automating human language translators.

*AI skeptic: So what? Who cares if some geeks can make computer programs easier?*

AI and automation are computer programs!

**AI is making it easier to improve AI.**

This is a feedback loop that results in exponential growth of AI. The more AI improves, the more AI is able to improve itself. Eventually this feedback loop gets so out of control that humans cannot keep up, a point known as the "singularity".

Humans are terrible at comprehending exponential growth, and thus I believe are drastically underestimating how quickly this is all developing.

Most seem to think that the job market for most people is going to be fine over the next decade - I vehemently disagree. I believe that AI will dramatically change society over the next few years and make the workforce drastically more competitive as AI starts to outstrip human ability. The labor market will become so competitive that UBI will become inevitable (I've been saying this for a decade, but never before has it looked so obvious and imminent).

The nature of work will move to a higher level of abstraction. Workers will become more like managers who delegate the "grunt work" to AI - responsible less for the nitty gritty of implementation and building tedious things, and responsible more for deciding what to build and where to direct the AI agents' focus. Just like fast mental math skills hasn't really been a competitive advantage since the invention of the calculator, doing any sort of repetitive, automatable work will not be of any advantage because the AI will be able to do it faster and cheaper at a speed of gigabytes/s, while being able to self-correct and debug itself. As tech becomes commoditized, humans will have to focus more on the "human" aspect such as marketing and zero sum games to economically compete.

The mistake that people who dismiss this tend to make is that they often believe that AGI is required for this mass societal transformation. I disagree. All it takes is for computer programs to be able to make the creation of computer programs easier to achieve this AI flywheel effect.

Anyways just some random thoughts here at 2:11am in Seoul.

LLMs create an Exponential Flywheel for AI Advancement

HN: <https://news.ycombinator.com/item?id=37345727>

Everything I wish I knew before moving 50,000 lines of code to React Server Components

Wavacity – a FOSS port of Audacity to the web

Apple is cutting off social media support!

"Amazon CEO Andy Jassy has a message to employees who don’t want to return to the office: “It’s not going to work out for you.” That’s according to [a report from *Insider*](https://www.businessinsider.com/amazon-andy-jassy-rto-office-policy-employee-jobs-2023-8), which says Jassy made that statement during a meeting earlier this month.

While [Amazon ordered its employees to return to the office](https://www.theverge.com/2023/2/17/23604485/amazon-return-to-office-three-days-a-week) for three days per week starting in May, many Amazon employees weren’t happy about the decision. [Thousands of workers signed a petition](https://www.businessinsider.com/amazon-hr-chief-rejects-petition-against-return-to-office-policy-2023-3) against the mandate and [staged a walkout in response](https://www.cnbc.com/2023/05/31/amazon-workers-plan-to-walk-out-over-lack-of-trust-in-leadership.html)."

Amazon CEO reportedly told remote employees: ‘It’s probably not going to work out’

HN: <https://news.ycombinator.com/item?id=37301991>

WebLLM: Llama2 in the Browser

It's clear that we're approaching the singularity, & most are drastically underestimating the impact that AI will have on society within the next couple years. Some predictions:

\- Humans will not be writing code by hand in a few years.

\- Workers will be expected to move "up the stack" of abstraction. Software engineers will be expected to be more high level product manager hybrids, serving more as technical business managers who delegate low level tasks to AI agents + cheap offshore workers

\- Rise in generalists. Expensive specialists are most at risk since AI democratizes knowledge + power

\- Gutting of the middle class, since most peoples' jobs are now very easy to automate

\- Rise in AI agents. Most of what you read online including on internet forums and in DMs, you won't be able to tell if it was written by a human or AI (already the case with recruiting). There is currently an arms race in AI agent development, the results of which we'll start seeing on society within the next 12 months.

\- The glory days of working in tech are over. Just like very other industry, it's only going to get more and more competitive. Salaries will at best remain stagnant. This is not specific to tech and will be the case for every industry. The industries most resilient will be those that require a human (eg. physical therapy)

The winners will be those who harness AI to their advantage, the losers will be everyone else.

I think most people are drastically underestimating the enormous impact that AI will have on society within even just the next 12 months. People are treating AI like a temporary fad or bubble, as if things will just return to the way they were before. But AI is not only here to stay, it's just getting started, and it's an arms race because everyone knows that AI will eat everything. Humans are terrible at understanding exponential growth, and most cannot comprehend how fast things are about to change.

Not trying to make this political - but I don't see any easier method of alleviating the hemorrhaging of the middle class than governments implementing a Universal Basic Income (UBI). Humans just cannot compete with a superintelligent autonomous AI that has parsed every book and document on the internet. We can continue to be in denial of this while our citizens suffer and overdose suicide to cope with the depression and bleak opportunities, or we can embrace AI and leverage it to free people to spend their time at their own leisure, moving society collectively up Maslow's Hierarchy of Needs. But given how blind and reactionary most people are to this kind of stuff, I don't predict anything changes until we reach a serious boiling point, so unfortunately billions will needlessly suffer in the meantime until the masses wake up to the cosmic societal shifts that are taking place as we speak.

<https://twitter.com/jeremybernier/status/1695350480388714605>

Implications of Approaching the Singularity

HN: <https://news.ycombinator.com/item?id=37250821>

Build a chatbot with custom data sources, powered by LlamaIndex

The following is my current go-to tech stack that powers my sites like [zsync.xyz](http://zsync.xyz) and [mindgarden.app](http://mindgarden.app)

Article: <https://www.jbernier.com/p?id=my-tech-stack>

Youtube video: <https://www.youtube.com/watch?v=Dz4VIJkA59M>

Twitter: <https://twitter.com/jeremybernier/status/1692236854907789666>

My Tech Stack (2023)

HN: <https://news.ycombinator.com/item?id=37137110>

Rama - Reducing the cost of building Mastodon at Twitter-scale by 100x

I've been building a Notion clone + publishing tool. Here I'll post dev updates (as well as on [Twitter](https://twitter.com/jeremybernier)).

Site: <http://mindgarden.app>

**2023-08-08** Just added Stripe payments and created landing page for <http://mindgarden.app>, my Notion clone (note-taking app) + publishing tool

Next I will prob make a video for the landing page showing what this is + how to use it b/c I don't think it's very clear. Then will try to get it in front of people to get feedback to validate the idea and/or refine the product/marketing.

I know the landing page is ugly because it's not a separate page, but a file directly in the app. I thought it'd be cool to immediately load the app and allow people to instantly start using the product (also I personally hate landing pages, but maybe I need to get over that). This makes it tough to style this page, but perhaps can figure something out later.

I'm building out some sites using <http://mindgarden.app>. Currently <http://codefire.dev> (built a couple days ago) and <http://jbernier.com> use the MindGarden API, and planning to build out those sites + more to show what it's capable of.

Will this succeed? Who knows. In any case I use the product myself, so at least there's one happy customer. We'll see if I can turn this into something useful for others as well.

Let me know what you think / open to feedback. I'm new to the whole entrepreneurship thing - this is actually my first time adding payments to anything I've made (wish I'd done this sooner).

<http://mindgarden.app>

<https://twitter.com/jeremybernier/status/1688814645598208000>

Build In Public - MindGarden

MetaGPT takes a one line requirement as input and outputs user stories / competitive analysis / requirements / data structures / APIs / documents, etc.

Internally, MetaGPT includes product managers / architects / project managers / engineers. It provides the entire process of a software company along with carefully orchestrated SOPs.

MetaGPT - Given one line Requirement, return PRD, Design, Tasks, Repo

Built this today: <https://codefire.dev> (work in progress)

Plan is for it to be a no-BS site for useful code snippets, boilerplates, and dev resources. No unnecessarily long-winded tutorials and SEO whoring, just straight to the point.

Backend API will be powered by my other app <http://mindgarden.app>, so it's simultaneously an excuse for me to battle test my own product + serve as a demo.

Currently just my content, but down the line will be publicly editable (eg. like Wikipedia) 

Tech stack: Next.js, Tailwind, MindGarden (API), Cloudflare Pages

Will post updates here

Build In Public - CodeFire.dev

Sweep is an open-source AI-powered junior developer. You describe a feature or bugfix in a GitHub issue and Sweep writes a pull request with code.

Demo Video: <https://www.youtube.com/watch?v=WBVna_ow8vo>

Tech

t/tech