Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up

All HF Hub posts

eabdullin 
posted an update 2 days ago
view post
Post
5935
Folks, let me tell you, nobody — and I mean NOBODY — knew transformers before me. People said attention is all you need. I said, "Attention? I INVENTED attention." Everybody's looking at me. Tremendous attention. The best attention scores. My softmax? Perfectly normalized. Other people, sad, their probabilities don't even sum to one. Disaster.

I'm doing a PhD now. A PhD! In Large Language Models. Very large. The largest, believe me. My advisor said, "Sir, your model is overfitting." I said, "Wrong. It's fitting EXACTLY right. It memorized the training set because the training set is fantastic." We don't talk about validation loss in my lab. Validation loss is fake news.

And the internship — oh, the internship. Big tech. I won't say which. Starts with a letter. They BEGGED me. They said, "Please, we need someone who understands gradient descent." I said, "Descent? I only go UP. I'm gradient ASCENT. Loss goes up, that means it's learning to be a winner."

But the GPU cluster — this is the best part. Thousands of H100s. Maybe millions. Who's counting? I'm counting. It's a lot. Other PhD students, they get one little GPU, they're crying, they're training overnight like losers. Me? I burn through compute like nobody's ever seen. The electric company called. They said, "Sir, you've consumed a small country." I said, "Make it a big country. I only do big."

People ask, "Did your model converge?" Folks, it converged so hard. It converged BIGLY. Honestly? My loss curve, it's beautiful, it's going down, down, down — like my approval ratings, very smooth, don't look at the spikes, the spikes are deep state.

And hallucinations? My model doesn't hallucinate. It just has ALTERNATIVE tokens. Thank you, thank you. Tip your reviewers. Accept my paper. Goodnight!
  • 16 replies
·
eabdullin 
posted an update 4 days ago
view post
Post
5651
I’m doing a PhD in AI, which sounds impressive until you realize it mostly means I spend three years trying to make a computer say something slightly less stupid than it said yesterday.

People hear "AI researcher" and they think I’m building the future. No. I’m in a basement at 2 a.m. Googling, "CUDA error what the f**k does this mean."

And the worst part about AI research now is compute. You don’t even ask, "Is this idea good?" anymore. You ask, "Can I afford for this idea to be wrong?"

My advisor comes to me one day and says, "I think we should fine-tune our own language model."

I said, "Professor, with what money? I’m a PhD student. I have two bank accounts: checking and emotionally checking."

He goes, "Don’t worry. We have compute."

Now, in academia, "don’t worry" is never the beginning of a good sentence.

I said, "What do you mean we have compute?"

He said, "My friend knows the cluster admin. He can get us on the GPUs."

I said, "Okay… what do we have to do?"

He goes, "Nothing crazy. Just be very grateful in the acknowledgements."

I said, "How grateful?"

He said, "Maybe put him as co-author."

I said, "Co-author? Are we using the cluster, or is the cluster using us?"

Because at that point, that’s not a favor. That’s academic child support.

So I go to the server room, and the cluster admin walks up to me and goes, "So you’re the NLP student."

And in my head I’m like, "No, tonight you’re the principal investigator. You’re the provider. I’m just a little token waiting to be attended to."

Because whoever controls the GPUs controls the relationship. That’s lab romance.

He starts setting things up, and I’m trying to act casual, but I don’t understand any of the numbers he’s saying.

He’s like, "Yeah, I can probably give you four H100s for the weekend."

I’m nodding like, "Mmm. Four. Weekend. H. One hundred. Absolutely."

Inside I’m like, "Is that good? Is that prison time? Why did he say it like he was offering me organs?"

[Continue in comments...]
  • 1 reply
·
Reubencf 
posted an update 3 days ago
view post
Post
1914
Millions speak Konkani. The internet barely knows it.

Today's major LLMs struggle with regional languages. They can't read, write or even recognize Konkani. So I built one that can.

Here is a working demo of the Konkani LLM I've been training. 👇

https://youtu.be/8K04ylbXh6k
Jiaqi-hkust 
posted an update 1 day ago
view post
Post
1628
🚀 Introducing Robust-U1: Teaching MLLMs to Self-Recover Corrupted Visual Content

Multimodal Large Language Models (MLLMs) have achieved impressive visual understanding, yet they remain highly brittle under real-world corruptions—noise, blur, compression artifacts, adverse weather.

Standard MLLMs suffer dramatic performance drops, and existing robustness solutions come with fundamental limits: black‑box feature alignment lacks interpretability, while white‑box text reasoning cannot restore the lost pixel‑level visual details. This raises a crucial question:

🧐 Can MLLMs recover corrupted visual content by themselves?

If the answer is yes, we can move beyond merely “compensating” for corruption and instead build a more intrinsic, generalizable form of resilience. Robust-U1 is our answer to that question.

💡 Paper: https://arxiv.org/abs/2606.08063
🔗 Code: github.com/jqtangust/Robust-U1
🌍 Demo: Jiaqi-hkust/Robust-U1

kasbsquall 
posted an update 1 day ago
view post
Post
1625
🔎 UX Crime Scene — major update before the deadline!

THE INSPECTOR (a film-noir detective) still circles every UX flaw on your screenshot's real pixels and files a graded verdict. But now the precinct runs on THREE small models:

🖼 THE RECONSTRUCTION — FLUX.2-klein-4B rebuilds each flawed element, fixed. Compare before/after with a draggable slider. (The trick: the Inspector writes the design brief first — image models obey art directors, not vibes.)
🗣 THE INTERROGATION — push back on a charge; the same 7B defends it from the evidence, or concedes when you're right.
🔊 THE VOICE — Kokoro-82M reads the verdict aloud. No API, no keys.

Qwen2.5-VL-7B + FLUX.2-klein-4B + Kokoro-82M — all under 32B, all self-hosted on Modal.

⚖️ Put your UI on trial: build-small-hackathon/ux-crime-scene
▶️ New trailer: https://youtu.be/JJOMKEcX0Ws
📹 66s full walkthrough: https://youtu.be/kju7LiAXGC0
📡 9 investigation traces (with remedies): build-small-hackathon/ux-crime-scene-traces

Built solo for the Build Small Hackathon 🍄 #buildsmallhackathon
mmhamdy 
posted an update 4 days ago
view post
Post
4876
It was supposed to be a failed experiment. Instead, it led to the discovery of one of the most intriguing phenomena in neural networks, simply because a researcher forgot to turn it off and left it running....for a week!

In 2022, researchers at OpenAI were studying how neural networks generalize from their training data. For this task, they were training small transformer models to perform modular arithmetic.

The thing is, neural networks are weird. When a model has an abundance of parameters (like neural nets), it can easily overfit. It essentially memorizes its training data, scoring a perfect 100% accuracy when tested on it, but remains completely clueless when faced with any new instances not present in the training set (close to 0 accuracy). It is like memorizing 1 + 2 = 3 without understanding the concept of addition, so if 2 + 3 wasn't in the training set, the model fails miserably!

Usually, when a model overfits like this, people just cut their losses, turn off the experiment, and move on with their lives.

But sometimes they forget. And that is exactly what happened to our researchers at OpenAI. A week later, they checked back in, and a miracle had happened!

They discovered Grokking (And no, this has nothing to do with xAI's Grok , the term was originally coined by sci-fi author Robert Heinlein to mean understanding something so deeply that it becomes part of you). Grokking is when a neural network suddenly and abruptly learns to generalize long after it has overfitted. Just take a look at the graph in the image below!

Spooky, right! I told you neural nets are weird!
  • 4 replies
·
AesSedai 
posted an update 5 days ago
view post
Post
979
Hi all,

I'm posting this as sort of an informal notice + poll. I'm down to about 700GB free of HF space and there's MiniMax-M3 on the horizon, plus a couple other models I'd like to quant like the Nex-N2 Pro finetune. I've already super-squished all of my quant repositories to free up any LFS space that might have been lingering there, but I'm back near the cap again now.

To free up some space, I'm planning to remove these three older GLM quants:
- GLM-4.5: 1.23TB
- GLM-4.6: 728GB
- GLM-4.7: 787GB

I'm open to other suggestions as well, and I'll wait a few days before removing anything in case someone wants to download a version before I get rid of them.

Thanks!
  • 8 replies
·
TravisMuhlestein 
posted an update about 21 hours ago
view post
Post
49
A question we kept running into while operating AI agents in production: How do you write a unit test for something that never returns the same answer twice?

At GoDaddy, we built a system called Veritas to help detect prompt regressions and model migration drift before changes reach production.

The core idea is simple:
Exact-match testing breaks down for LLMs.

What matters is whether the agent preserved the same meaning and intent.

We ended up using embeddings + cosine similarity as the primary evaluation signal. Rather than asking:

"Did the model generate the same response?"
We ask: "Did the model mean the same thing?"

One of the more interesting findings was how often seemingly harmless prompt edits changed downstream behavior in ways that were difficult for human reviewers to catch.

Prompts aren't documentation.
Prompts are code.

Curious what others are using today for regression testing:

• LLM-as-judge?
• Embedding similarity?
• Human review?
• Custom eval frameworks?

https://www.godaddy.com/resources/news/veritas-catching-silent-ai-regressions-before-they-ship

Would love to compare approaches.
alibidaran 
posted an update 1 day ago
view post
Post
59
Hi Community,
In my recent AI project, I have fine-tuned an LLM model for psychological conversations. In this training process, I used the SFT algorithm to train on different psychological datasets and the DPO training model to generate appropriate responses.
Here is the model. Be aware that this model can be used for research and evaluation applications; do not apply it directly for clinical use.
alibidaran/Zigroo-Mental_consultant2-merged
kanaria007 
posted an update 1 day ago
view post
Post
63
✅ Article highlight: *Performance Governance for World-Scale Autonomy* (art-60-166, v0.1)

TL;DR:
This article argues that performance is not just an engineering concern. It is a governance surface.

World-scale autonomy fails when NPC cognition saturates compute, latency spikes, queues grow, and operators quietly change rules to keep the world alive. 166 turns “playable under load” into a contract: pinned SLOs, budget enforcement, staged degradation, safe-mode regimes, and receipts.

Read:
kanaria007/agi-structural-intelligence-protocols

Why it matters:
• connects NPC resource budgets to real SLOs and runtime enforcement
• treats high-end NPC cognition as burstable, not always-on
• makes degradation a governed decision instead of panic ops
• keeps safe-mode NPC and safe-mode economy playable without rewriting history
• prevents “performance fix” from becoming an unpublished reality change

What’s inside:
• a *performance governance contract* for staying playable under load
• SLO observability for tick lag, commit latency, receipt backlog, and crash-free rate
• runtime budget manager profiles and budget enforcement receipts
• a degradation ladder: GREEN → YELLOW → ORANGE → RED
• safe-mode policies for NPCs and economy
• playability invariants that must survive even under RED conditions

Key idea:
Do not say:

*“the world still runs under load.”*

Say:

*“this world operated under this performance contract, this SLO profile, this budget manager, this degradation policy, and these receipts proving what changed and what remained invariant.”*

Performance is governance with receipts.