Skip to content
View ArunTamil21's full-sized avatar

Block or report ArunTamil21

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ArunTamil21/README.md

Hey, I'm Arun

Escalation engineer at Microsoft working on AI and IoT. Spending my nights and weekends going deeper into systems programming because I want to understand how things actually work — not just use them.

Over the last few months I've built a CPU matmul kernel from scratch with SIMD and cache blocking, a tensor engine, and a forward pass neural network, all in pure Rust, zero dependencies. Recently went down the async Rust rabbit hole and built a mini runtime from scratch — raw vtables, custom wakers, no Tokio. Dense and rewarding.

Now moving into GPU programming. Same approach, understand it from the ground up before using abstractions.

Long term I'm moving toward ML inference engineering, the intersection of low-level systems, GPU programming, and the infrastructure that makes LLMs actually run fast.

What I'm working with

  • Rust — SIMD, async internals, systems programming
  • CUDA — learning GPU programming through PMPP
  • Azure AI / IoT — day job, escalation engineering

On the horizon

  • CUDA matmul kernel
  • Inference scheduler in Rust

Pinned Loading

  1. matmul-simd matmul-simd Public

    High-performance matrix multiplication with SIMD, built from scratch in Rust

    Rust 2

  2. tensor-engine tensor-engine Public

    Tensor engine from scratch in Rust — generic ops, AVX2 matmul, autograd with backward pass, linear regression. No PyTorch, no ndarray.

    Rust

  3. Async-Rust-Runtime Async-Rust-Runtime Public

    Single-threaded async executor built from scratch, custom Waker, RawWakerVTable, and TimerFuture with no Tokio

    Rust

  4. async-connection-pool async-connection-pool Public

    Bounded async resource pool with RAII guard pattern, the same primitive that manages GPU KV cache slots in inference engines

    Rust

  5. async-exponential-backoff-with-jitter async-exponential-backoff-with-jitter Public

    Generic async retry with exponential backoff and jitter, prevents thundering herd in distributed systems

    Rust

  6. Chat-Server Chat-Server Public

    Multi-client TCP broadcast chat server with graceful shutdown using Tokio and CancellationToken.

    Rust