AI & ML interests

None defined yet.

Recent Activity

takarajordanย 
posted an update about 17 hours ago
view post
Post
54
Super impressed with the UltraBERT team at @dmis-lab โ€” @affjljoo3581 , @Taewhoo and Jaewoo Kang โ€” for continuing to push encoders forward. Really impressive work!

I knocked up an MoE version on a single A100, entirely for fun: UltraBERT-Embed-MoE-8x.

8 experts per routed layer, 2 active per token. Works pretty well in my small retrieval tests!

Huge credit to the original team for making this possible.

Original: dmis-lab/UltraBERT-Embed-150M
MoE: takarajordan/UltraBERT-Embed-MoE-8x
Parveshiiiiย 
posted an update 1 day ago
view post
Post
1,756
Most AI image detectors work fine in the lab and fail on social media.

The reason is simple. Real photos get compressed, resized and re-uploaded again and again, and detectors trained on clean images read that damage as a sign of fakery. A real photo that has passed through a few platforms often gets flagged as AI-generated.

AIRealNet-2 is built to fix that. It is the upgrade to our original Modotte/AIRealNet, trained on images collected from platforms like Instagram and X, so it has seen the kinds of quality loss and compression real images go through online.

The training set has 98k images, split 50/50 between AI-generated and real, so the model has no class bias to lean on. Personal photos were excluded by design, including AI-edited ones.

The architecture is unchanged: a SwinV2 Tiny backbone with a binary classification head, about 0.2B parameters, working at 256x256 resolution. It stays fast and easy to deploy for research or production.

Model: Modotte/AIRealNet-2
  • 3 replies
ยท
SeaWolf-AIย 
posted an update 3 days ago
view post
Post
5,361
HF Post draft (English) โ€” FreeWeb Security SCAN
๐Ÿ›ก FreeWeb Security SCAN โ€” free web security & AI-visibility check

Drop in a domain and get a non-intrusive (read-only) assessment in ~10โ€“25s. No login, no install, no credit card.

What it checks Security headers ยท HTTPS/HSTS ยท cookies ยท TLS certificate ยท CORS ยท exposed files; email security (SPF ยท DKIM ยท DMARC ยท BIMI ยท MTA-STS ยท TLS-RPT); DNS (DNSSEC ยท CAA ยท MX ยท NS); site-wide mixed content & external-script SRI; SEO foundations; and reachability of 9 AI/search crawlers (GPTBot ยท ClaudeBot ยท PerplexityBot ยท OAI-SearchBot ยท Googlebotโ€ฆ) โ€” your AI visibility (GEO).

Why now AI agents now break in on their own. In 2026 the open-source AI penetration agent ARTEX was turned on real targets โ€” hitting 2,250+ Microsoft 365 tenants, breaching e-commerce order databases, and automating recon-to-exfiltration against unpatched internet-facing systems worldwide. Attacks are automated โ€” so must defense be.

3 steps โ‘  Free instant scan โ†’ โ‘ก Domain-verified deep scan (HF login on your org-domain email) โ†’ โ‘ข In-depth consultation (Web ยท AX Infra ยท AI Model ยท AI Agent). Aligned to OWASP ยท NIST ยท ISO ยท EU AI Act.

๐Ÿ‘‰ Scan now: FINAL-Bench/FreeWeb-Security-SCAN

#websecurity #cybersecurity #AIsecurity #SEO #GEO #AIvisibility #SPF #DMARC #OWASP #LLM
  • 1 reply
ยท
SeaWolf-AIย 
posted an update 4 days ago
view post
Post
7,191
We pretrained a 325M language model from zero on an inference-only NPU

The accepted view is that inference-only NPUs cannot train, let alone pretrain a language model from scratch. We put that view to a direct test on the Rebellions ATOM-Max, a commercially available Korean NPU released in 2025 and designed for inference. We built our own training loop that runs backpropagation on the chip itself. Starting from random initialization, we pretrained VKORE-325M-NPU-Base, a 325.6M parameter model, on 5 billion byte tokens of FineWeb-Edu. The run took 76,292 steps over about four days and finished without a single divergence. No pretrained weights were used.

To make the comparison fair, we trained the same model on a B200 GPU with identical initialization, data and learning-rate schedule. On 1,024 windows of text that neither model ever saw, the NPU reached a loss of 0.7993 and the GPU 0.7994. The window-by-window difference is -0.0001, well inside the noise. The two models are indistinguishable.

This is seven times larger than our first NPU model, VKORE-46M, and the first time this hardware has carried a real pretraining run to GPU quality. Please note that the hardware alone does not make this possible: the NPU and its standard software are built for inference, and training on it depends on our own training stack and stability technique, which are developed in house and under patent application. Buying the chip does not by itself enable training. Both sets of weights and the evaluation script are public, so anyone can verify the result in minutes.

๐Ÿ“„ Technical report: https://huggingface.co/blog/FINAL-Bench/pretraining-a-325m-language-model-from-zero-on-an
๐Ÿค— Models: FINAL-Bench/VKORE-325M-NPU-Base

#NPU #Rebellions #Pretraining #VKORE
  • 8 replies
ยท
Parveshiiiiย 
posted an update 12 days ago
view post
Post
193
Give your LLM a window to the web ๐Ÿ”Ž

I built Seekify, a Python tool that turns web search into clean, LLM-ready input for free.

Collecting sources for an LLM workflow usually means juggling search APIs, scraping pages, and cleaning up messy text. Seekify handles that in one place:

- No search API key needed
- Structured results with titles, URLs, and snippets
- Optional page text extraction so your model gets real content, not just links

Search the web, collect sources, and feed them straight into your pipeline, so you spend less time gathering data and more time building.

It's open source, and I'd love your feedback, ideas, and contributions.

๐Ÿ‘‰ https://github.com/Parveshiiii/Seekify

If it's useful, a โญ on GitHub helps a lot!
SeaWolf-AIย 
posted an update 16 days ago
view post
Post
2,781
๐Ÿš€ We pretrained a language model from scratch on an inference-only NPU, with real backpropagation.

๐Ÿค— Model: FINAL-Bench/VKORE-46M-NPU ๐Ÿ“ Technical write-up: https://huggingface.co/blog/FINAL-Bench/backpropagation-on-an-inference-only-npu-pretraini

"NPUs are inference-only, you can't train on them." We built a counterexample: VKORE-46M-NPU, trained from scratch on a first-gen (2025) inference NPU, 32 chips, no pretrained weights. A 46M decoder-only model (RoPE ยท SwiGLU ยท RMSNorm ยท GQA), char-level, TinyStories.

๐Ÿ“ Why trust it: a falling-loss curve proves nothing. So we trained the same model under identical init, data, and schedule on the NPU and on a GPU reference. ยท Loss trajectories correlate at 0.99 ยท Throughput converged to a comparable level The NPU backward pass and optimizer updates do numerically the same work as the GPU, not an approximation that merely trends down.

๐Ÿงฉ One accelerator now covers pretraining ยท LoRA ยท inference ยท quantization. We call this layer VKORE: "CUDA for NPUs."

โš–๏ธ Public: weights, model card, NPU-vs-GPU comparison. Private (patent-pending, paper to follow): the core training technique. 46M char-level is toy scale on purpose: it proves the training path, not model quality. Larger models and real data are next.

Feedback from folks working on custom autograd backends and low-precision training kernels on non-GPU accelerators is very welcome. ๐Ÿ™Œ
  • 10 replies
ยท