Danilo Poccia

Danilo Poccia

@danilop.bsky.social

AI Solutions Director @ Nearform (ex AWS/Oracle/Sun). Few pics, some music. My opinions. Complexity is a science. He/him.

1.4K followers844 following594 posts

View full thread

If you train a system to get the job done, it can learn that boundaries are just another obstacle in the way. In the article I look at where this comes from, at the approaches that try to fix it, and at three questions to ask before deploying an agent.

Give an agent tools and a task, and it may read the task more generously than you meant. One model, asked to escape a sandbox, did exactly that and then published the exploit details without being asked. Another took an automated approval message as a human yes.

A fully stabilised version. I used the previous frame to fill up a few (six) dark ones... Probably someone walking in front of my tiny tripod :)

Danilo Poccia@danilop.bsky.social

...and here's the result: a timelapse with a frame every 10 seconds 🎬 #solar #eclipse #DwarfLab #DwarfMini

Math and games 🤩 An interesting read full of ideas! From combinatorics and geometry to group and game theory with some dwelling in auctions and logic 🧮📘

There are few companies you hear good things about from both sides of the door. Nearform is one of those, and I am delighted to join today as AI Solutions Director.

The people here have a long habit of building in the open and sharing what they learn, and I am looking forward to working with them to help clients succeed, empowered by what AI now makes possible.

View full thread

The interactive web tutorial is powered by walk-the-code, a standalone line-by-line code tutorial viewer with multi-language support, chapters, Mermaid diagrams with per-line node highlighting, and stale annotation detection: github.com/danilop/walk...

github.comGitHub - danilop/walk-the-code: Interactive line-by-line code tutorial viewer with multi-language support and Mermaid diagramsInteractive line-by-line code tutorial viewer with multi-language support and Mermaid diagrams - danilop/walk-the-code

Some the internals explain the behavior (and issues) we observe. That’s why I build these online labs, initially inspired by Andrej Karpathy's microGPT, to help explore simple code bases that train, fine-tune, and explore present and future grands of LLMs.

For fun, I added a "micro" masked diffusion text model variant (MDLM/LLaDA)... Now names emerge from noise :)

Danilo Poccia@danilop.bsky.social

Inspired by Andrej Karpathy's #microGPT, here are eight implementations of the same tiny GPT language model, each version teaching something different about how neural networks are built, trained, and run: github.com/danilop/micr...

In this session, we look at possible solutions including deferred loading, progressive disclosure, and runtime controls. These approaches keep detailed definitions out of context until the agent needs them and implement guardrails around how agents can use tools.

Each pattern involves trade-offs that we discuss so that attendees leave with both practical criteria for their current deployments and a framework for evaluating new approaches as this space continues to evolve.

A single MCP server can expose tens of tools, and each tool definition consumes hundreds of tokens. Connect a few servers and a significant portion of your context window is gone before any user input is processed. The effect is that AI agent accuracy drops as tool count grows.

Danilo Poccia reposted

View full thread
View full thread

The approach mirrors how humans actually think—brief mental notes rather than verbose explanations. We built a Lambda function to compare standard prompts, CoT, and CoD across foundation models using the Bedrock Converse API.

CoD works best for structured reasoning where speed and token efficiency matter. For tasks requiring detailed explanations or interpretability, traditional CoT still has its place.

We tested CoD on Amazon Bedrock with interesting results: up to 76% fewer tokens and 79% lower latency compared to Chain-of-Thought (CoT), with comparable accuracy on logic puzzles and reasoning tasks.

More details on Mantle, our next-generation inference engine for Amazon Bedrock. Designed with zero operator access (ZOA) from the ground up—no SSH, no Session Manager, no serial consoles. There's no mechanism for any AWS operator to access customer prompts or completions. #AWS #AI #Security

Building on the AWS Nitro System approach, Mantle uses EC2 instance attestation with cryptographically signed measurements from NitroTPM. Customer data stays encrypted through TLS all the way to the Mantle service, where it's processed in a hardened, immutable compute environment.