Research done together

Collaborations

Some of these started with a comment we left under someone's paper or post, some with a message someone sent us. Each has its own subject and its own twists.

Illustration: four workbenches in a sunlit studio, a graphics card with two gauges, decision cards beside a stormy island, a glass case of glowing dots with a fruit fly and a row of app blocks, all joined by glowing threads to one open notebook of charts.

In half a minute

Three people, three different questions. Each of them builds something of their own, and we work with them on one question, in the open.

Anagha Langhe checked whether a lighter version of her model (FP8) answers worse. Out of 120 questions, only one went from right to wrong.

Mark Goodbody tested whether his reasoning frameworks change what ChatGPT and Claude decide. In these runs the main distinctions appeared with and without them, so no benefit is established yet: the models already keep "what we can say" apart from "what we should do" on their own.

Mohan Bheemadolu squeezes an agent's memory into tiny codes, and together we're testing whether that makes two AIs agree on the same wrong answer more often.

Watch on YouTube

The stories

Three advisers recommend the school, all from the same two-year-old map. One adviser has today's inspection saying the school's step-free entrance is closed. Both AIs counted the three as one source, with or without Mark's framework in front of them.

Do AI models already keep a claim apart from an action?

with Mark Goodbody · systems engineer, UK · author of Mechanical Ethics and TRACE

Read the story →

How a collaboration works

  1. You bring a question, a system or some data: a model you run, a memory for an agent, a set of cases, a paper you want to put to the test.
  2. Before looking at any results, we agree on what to run and what would count as an answer.
  3. Each side runs its part. Everything that can be open is open: code, prompts, raw answers, numbers.
  4. The story goes on a page like these, in plain words, with your name and links, and grows as the work does.

Propose a collaboration

Tell us in a few lines what you are working on, what you would like to find out, and where your code or paper lives. We read everything and answer personally.

polyhelper.ai@gmail.com