systems_engineer.sh

Sudhanwa Kaveeshwar

AI Engineer specializing in Agentic AI, Generative AI, LLM Systems, and Data Engineering

AI Engineer with 4+ years of experience building production-grade AI and data systems. I specialize in Python, LLMs, agentic workflows, RAG, real-time data pipelines, and distributed data platforms. My work spans AI assistants, self-service analytics, streaming systems, risk analytics, and data-intensive backend infrastructure. I focus on turning AI capabilities into reliable, observable, and production-ready systems rather than isolated prototypes.

Currently Building
/now

Building production-grade agentic AI systems, AI intelligence layers, and data-driven decision systems with LLMs, tool-using agents, real-time pipelines, and scalable backend infrastructure.

Selected Projects(3)

view all projects
AI & ML2026

Self-Attention Kernel & Inference Engine from Scratch

Implementation of FlashAttention-style tiled multi-head attention kernels in C++/CUDA and custom PyTorch C++ extensions with benchmark comparisons.

Speedup vs Naive PyTorch3.8x
Peak SRAM Utilization91%
C++20CUDAPyTorch+2
Data Engineering2026

Distributed Low-Latency Stream Processor in Rust

A zero-copy, fault-tolerant distributed streaming engine built in Rust for processing 1.5M+ events/sec with sub-millisecond p99 stateful window aggregations.

Throughput (Single Node)1.48M ev/s
p99 Window Latency0.85 ms
RustApache ArrowKafka+3
GenAI2026

Multi-Agent GenAI & RAG Evaluation Harness

An automated regression and evaluation suite for testing complex RAG retrieval, multi-hop reasoning, tool invocations, and semantic drift with synthetic dataset generation.

Eval Throughput10k runs/hr
Judge-Human Correlation0.91 Pearson
PythonPyTorchvLLM+4

Recent Experience

full timeline

Data Scientist

@ Bajaj Finserv Health

Spearheading real-time streaming infrastructure, distributed data marts on Azure Databricks, graph-based recommendation engines, and self-serve AI analytics platforms.

PythonApache KafkaAzure DatabricksApache Airflow
10/2024 — 06/2026

Associate Data Scientist

@ Bajaj Finserv Health

Designed high-throughput Python ELT pipelines, AI assistant backends for healthcare triage, and automated lab scoring engines.

PythonOpenAI AssistantGoogle BigQueryAzure Data Lake
07/2023 — 10/2024

Data Science Intern

@ Bajaj Finserv Health

Developed configuration-driven ETL workflows, cloud storage lifecycle archival pipelines, and cost-optimized data marts.

Azure Data FactoryAzure Blob StorageSQLData Modeling
07/2022 — 07/2023

Engineering Notes & Writing

all articles
4 min read

Understanding KV-Cache Optimization in Modern LLM Serving

A deep dive into Key-Value caching mechanics, memory fragmentation bottlenecks, PagedAttention, Multi-Query Attention (MQA), and speculative prefix caching.

#LLM Inference#Systems#CUDA#vLLM#Memory Optimization
2 min read

Zero-Copy Data Pipelines in Rust with Apache Arrow

How memory-mapped buffers, cache line alignment, and Apache Arrow columnar formats eliminate serialization overhead in high-throughput analytical streaming.

#Rust#Apache Arrow#Data Engineering#Performance#Systems