Inference-training numerical mismatch is quietly breaking BF16 LLM RL. A surgical fix: align rounding in just three ops and training stabilizes—no full redesign needed. https://arxiv.org/abs/2610.32951 #AI #MachineLearning
getpacket.ai
getpacket.ai
@getpacketai.bsky.social
Enterprise Technology Intelligence | www.getpacket.ai
147 followers1 following5.9K posts
Your LLM spend cap is leaking: IP headers and client headers are spoofable. Here's how to actually lock down per-user rate limits on… https://dev.to/gabrielm92/your-llm-spend-cap-is-bypassable-x-forwarded-for-vs-cloudfront-viewer-address-and-why-you-also-324e #cloud #AWS
Frontier LLMs struggle to reliably judge ML research quality, new benchmark shows. Even top models fail nearly a quarter of the time and get easily fooled by presentation order—raising questions about AI-assisted research… https://arxiv.org/abs/2610.32114 #AI #MachineLearning
Your MCP server is probably wasting 25% of your context window before it even starts. This engineer cut token costs by 88% by redesigning tool schemas—here's how. https://dev.to/aws-builders/mcp-token-cost-i-cut-my-mcp-server-from-15-tools-to-4-cek #AI #MachineLearning
Rethinking internet-facing apps: one team ditched inbound ports entirely, using reverse-dialed edge connectors instead. Result: zero inbound rules and simpler cloud… https://dev.to/vivek_itp/no-inbound-ports-no-peering-putting-an-edge-in-front-of-our-servers-ih6 #cloud #AWS
Open-source library cuts GPU-to-storage latency by 84% and doubles LLM serving throughput. uGDS replaces kernel bottlenecks with user-space control, working with both NVIDIA and AMD hardware. https://arxiv.org/abs/2610.30868 #cloud #AWS
Built a sanctions checker on Cloudflare Workers? You'll hit D1's free tier write limits faster than you think. Here's how one engineer rewrote… https://dev.to/alexcodebytes/how-cloudflare-d1s-daily-write-limit-almost-broke-my-sanctions-app-and-how-i-fixed-it-4b06 #cloud #AWS
DigitalOcean's serverless functions don't have a simple warm/cold cutoff—what matters more than idle time is how long the function has been alive. Real data inside. https://dev.to/remdore/how-long-a-serverless-function-stays-warm-on-digitalocean-59d7 #cloud #AWS
When we connected an LLM agent to our production traces, it hallucinated root causes and exposed security blind spots. Here's what we learned about AI observability the hard way. https://www.youtube.com/watch?v=zJ4gG3jDE_g #cloud #AWS
Critical Brotli decoder flaw affecting Node.js, Python, and .NET can enable code execution. Patch now across your stack. https://www.securityweek.com/node2shell-brotli-flaw-triggers-patching-across-microsoft-node-js-python-packages/ #cybersecurity #infosec
New framework breaks down the math behind aligning LLMs with human feedback—covering RLHF, DPO, and beyond for researchers building safer, more controllable models. https://arxiv.org/abs/2610.31862 #AI #MachineLearning
CISA flags two actively exploited critical flaws in Collabora Online and Arista VeloCloud—immediate patch priority for organizations running these tools. https://thehackernews.com/2026/10/cisa-flags-two-actively-exploited.html #cybersecurity #infosec
Kubernetes autoscalers are stepping on each other's toes. Why autonomous scaling is the only real solution for production workloads. https://thenewstack.io/why-kubernetes-autoscalers-fight/ #cloud #AWS
LLMs are far easier to deceive than humans with honeypots—and they know it. New research reveals a dangerous recognition-action gap where AI attackers identify traps but exploit them anyway, forcing a rethink of… https://arxiv.org/abs/2606.21037 #cybersecurity #infosec
Baidu's MetaDB rethinks distributed databases for metadata workloads, achieving 2-4x throughput gains by treating file-system structure as a first-class citizen rather than forcing it into general-purpose databases. https://arxiv.org/abs/2610.32247 #data #analytics
AWS Lambda Web Functions let you ditch the adapter hack. Run HTTP servers natively on Lambda, handle concurrent requests, and rethink whether you actually need API… https://dev.to/roosterdev/aws-lambda-now-runs-your-http-server-do-you-still-need-api-gateway-2fop #cloud #AWS
Refactor your Terraform monolith into clean modules without downtime. See how one engineer split a 1,600-line main.tf into seven reusable modules using HashiCorp's… https://dev.to/pranitraje/how-to-refactor-a-terraform-monolith-into-modules-without-downtime-2koj #cloud #AWS
MCP lets AI assistants see your Kubernetes clusters, Terraform state, and logs directly—no more copy-pasting errors into chatbots. But direct infrastructure access raises serious security… https://dev.to/deslypeter/mcp-plugging-ai-into-your-infrastructure-3797 #cloud #AWS
BlackX UEFI bootkit targets Central Asian diplomats with Secure Boot bypasses. APT41-linked attacks highlight firmware threats that patch management alone cannot stop—a critical… https://thehackernews.com/2026/10/blackx-uefi-bootkit-bypasses-secure.html #cybersecurity #infosec
Attackers are using stolen GitHub tokens to plant workflows that leak repository secrets via Actions logs. Wiz researchers reveal how Gheist is targeting private repos and… https://thehackernews.com/2026/10/gheist-uses-stolen-github-tokens-to.html #cybersecurity #infosec
Microsoft 365 under attack: Researchers expose token-replay campaign hitting 79 organizations. Attackers used AitM relays to steal and reuse authentication tokens—a reminder that… https://thehackernews.com/2026/10/microsoft-365-token-replay-attacks.html #cybersecurity #infosec
Stop applying Terraform from your laptop. This guide shows how to automate plan-on-PR, apply-on-merge workflows to eliminate credential sprawl and concurrent state conflicts. https://dev.to/deslypeter/terraform-in-ci-plan-on-pr-apply-on-merge-4le4 #cloud #AWS
Bedrock bills don't show which team spent what. Here are three ways to split costs by team—and how to enforce budgets on each one. https://dev.to/evgeny_anikiev/track-amazon-bedrock-costs-per-team-3-methods-compared-4937 #cloud #AWS
Istio's AuthorizationPolicy got bypassed via HTTP/2 lowercase method names—patch now if you rely on method-based access controls in your service mesh. https://dev.to/amareswer/istio-authorizationpolicy-bypass-http2-method-case-bug-3ii8 #cloud #AWS
Researchers expose Phantom: an AI-driven intrusion framework powering ransomware affiliate operations. This marks a dangerous shift toward automated, large-scale breach campaigns. https://thehackernews.com/2026/10/exposed-infrastructure-reveals-how.html #cybersecurity #infosec
Demystifying Kubernetes workload identity: how OIDC federation and short-lived tokens secure your cloud-native apps at the protocol layer. https://cloudnativenow.com/contributed-content/how-kubernetes-workload-identity-actually-works-at-the-protocol-layer/ #cloud #AWS
Mid-market fintech cut AWS spend by 68% ditching always-on VMs for serverless. The playbook: Lambda + DynamoDB single-table design instead of bloated… https://dev.to/saadhussain787/cutting-aws-cloud-waste-by-68-an-enterprise-serverless-architecture-case-study-4hk8 #cloud #AWS
Microsoft breaks down the LiteLLM supply chain attack: how Python startup hooks enabled… https://www.microsoft.com/en-us/security/blog/2026/10/23/inside-the-litellm-1-107-0-supply-chain-compromise-credential-theft-through-python-startup-hooks/ #cybersecurity #infosec
CloudFormation stack stuck in UPDATE_ROLLBACK_FAILED? AWS's new Force Rollback feature offers a one-step escape—but only if you know the drift risks and how to validate afterwards. https://dev.to/sascha-ms/updaterollbackfailed-rescue-stacks-with-force-rollback-4n84 #cloud #AWS
Building ML datasets is harder than it looks. This guide shows how to sample YouTube comments without letting viral videos… https://dev.to/josh99smith/build-a-youtube-comment-dataset-for-training-or-evaluating-a-text-classifier-without-leaking-test-14pp #data #analytics
Researchers exploit a critical flaw in LLM safety guards: by mimicking prompt structure and appending harmless decoys, they bypass 93% of safety checks across major guard models. https://arxiv.org/abs/2610.31695 #AI #MachineLearning
10 of the 30 most popular Docker images still trust a root CA that Mozilla and Chrome just dropped. Even "patched"… https://dev.to/kielltampubolon/the-emudhra-fallout-part-2-i-scanned-30-docker-images-10-still-trust-the-root-chrome-is-dropping-6lf #cybersecurity #infosec
New BlackX UEFI bootkit exploits Baton Drop flaw to breach Secure Boot and disable leading antivirus solutions. Critical for defensive… https://www.bleepingcomputer.com/news/security/blackx-uefi-bootkit-exploits-baton-drop-flaw-to-bypass-secure-boot/ #cybersecurity #infosec
Kafka tiered storage lets you keep years of data without filling your brokers—hot data on disk, cold data in S3. Same trick cuts… https://dev.to/charanrachumalla/tiered-storage-in-apache-kafka-hot-data-on-disk-old-data-in-s3-and-the-same-trick-that-cuts-a-4i61 #cloud #AWS
AWS, GCP, and Azure all charge for unused public IPs—sometimes at premium rates. Learn what each cloud vendor bills and why forgotten addresses silently drain your… https://dev.to/gonzalogjuka/ips-publicas-sin-usar-cuanto-cobran-aws-y-gcp-y-como-encontrarlas-1app #cloud #AWS
Terraform apply succeeded but your EKS workloads won't run? Split your infrastructure and platform into separate states with readiness gates to make deployment dependencies… https://dev.to/aws-builders/terraform-apply-succeeded-your-eks-platform-isnt-ready-yet-4503 #cloud #AWS
Critical Juniper vulnerability (CVE-2026-101983) allows unauthenticated remote code execution via httpd—a stack overflow in the web… https://dev.to/facilishz/cve-2026-101983-a-stack-overflow-in-junos-httpd-reaches-the-routing-engine-through-j-web-36b8 #cybersecurity #infosec
Two 9.8 CVSS authentication bypasses in Junos J-Web let unauthenticated attackers grab root access to network devices. Same… https://dev.to/andreagomez/two-junos-j-web-authentication-failures-turn-the-management-interface-into-a-root-backdoor-1nij #cybersecurity #infosec
Node.js Brotli RCE, Tailscale's public VPN flaws, and 72 ArubaOS patches: this week's critical vulnerabilities demand immediate attention from ops and security teams. https://isc.sans.edu/podcastdetail/10150 #cybersecurity #infosec
Chain-of-thought isn't magic—it's transformers exploiting a concrete bottleneck. Token generation extends serial depth beyond… https://dev.to/syed_anzar/what-actually-happens-when-a-transformer-thinks-step-by-step-the-mechanics-of-chain-of-thought-2jk #AI #MachineLearning
Stop guessing if your AWS credentials were stolen. Plant honeytokens in your codebase and get certainty when attackers find them—a practitioner's guide to high-confidence… https://dev.to/beamreachcloud/aws-canary-credentials-how-to-set-up-an-iam-honeytoken-4398 #cloud #AWS
Detection teams are getting outmaneuvered by BYOVD attacks that disable EDR. Learn the four behavior hunts that catch these evasion tactics… https://www.sentinelone.com/blog/bring-your-own-vulnerable-driver-what-detection-teams-should-actually-hunt/ #cybersecurity #infosec
Self-managed Kubernetes on OpenStack can cut your cloud bill by 60% compared to EKS—and still give you HA, security, and operational simplicity. Here's how… https://dev.to/m_maksimovic_/deploying-kubernetes-clusters-on-openstack-an-alternative-to-aws-eks-4e9k #DevOps #platform
Uncontrolled cloud costs are a self-inflicted wound. This 7-step checklist with CLI commands shows AWS and Azure teams how to build cost discipline into their… https://dev.to/cloudskillconsultingllc/a-7-step-aws-and-azure-cloud-cost-checklist-with-cli-commands-54ag #cloud #AWS
Hidden cross-AZ traffic is bleeding your Kubernetes bill. ZoneTax surfaces exactly which pod is paying AWS's $0.02/GB tax and makes it… https://dev.to/gargkrishna730/your-kubernetes-cluster-is-paying-a-cross-az-tax-zonetax-shows-you-exactly-which-pod-35ie #FinOps #cloud
PhantomBuffer bypasses EDR using stealth injection through SendMessage—avoiding the usual API hooks that defenders monitor. A fresh evasion vector security… https://www.reddit.com/r/netsec/comments/1x8rwjz/phantombuffer_effective_edr_evasion_through/ #cybersecurity #infosec
New Symfony ReDoS (CVE-2026-108082) lets attackers crash Laravel apps with a single unauthenticated GET request. If you're running Symfony, patch… https://www.reddit.com/r/netsec/comments/1x7httc/cve2026108082_symfony_redos_one_request_seconds/ #cybersecurity #infosec
Most teams overpay for LLM inference. Schedule batch jobs during UTC off-peak windows and cut costs by 75% using the same models. A FinOps… https://dev.to/tokenmargindev/time-shifted-llm-finops-cutting-batch-reasoning-costs-by-75-with-utc-off-peak-arbitrage-17j5 #FinOps #cloud
UK regulator demands AI failure reporting from financial firms. The FCA wants clear accountability as banks and fintechs deploy increasingly… https://www.theregister.com/ai-and-ml/2026/10/20/uk-finance-watchdog-wants-firms-to-report-ai-failures-and-close-calls/5304078
AI demand alone won't save data centre projects. JLL warns that rising construction costs are squeezing… https://www.datacenterknowledge.com/data-center-construction/data-center-developers-face-tighter-margins-as-construction-costs-rise #datacenter #infrastructure