Hi, I'm AJ, an aspiring AI Research Engineer, I enjoy writing software that I have a vision for. I also like reading academic subjects.
Core Field: Applied LLM & MLLM
Auxilliary Field: NLP Research: Mechanistic Intrepretabilty
Target Field: Embodied AI
Co-authored two papers, contributed to the paper structure, research questions, and related studies.
• First-Token Broadcasters: Mechanistic Origins of Language Identity and Distributed Robustness in Transformers: Paper on the mechanistic origins of language identity and distributed robustness in Transformers.
• FTB Graph: Determining and Validating First-token Broadcasters and Language-Identity Head Circuits in Multilingual Language Models: Paper on determining and validating first-token broadcasters and language-identity head circuits in multilingual LLMs.
Working with post-trained LLM APIs and building softwares around them.
• Immersia WIP: Generative-AI visual novel immersive world
• Syneuro WIP: Neuro-symbolic affective-computing framework for conversational agents
• MemoryGate WIP: A lightweight memory layer for roleplay chat agents
• AetherRouter WIP: Async, multi-provider LLM routing and fallback engine
• QSenti WIP: Lightweight sentiment classifier for LLM sessions powered by VADER & Quantum-inspired Math
Working with PyTorch ecosystem and neural network architectures.
• feedforward-neural-network WIP: A Feedforward Neural Network from scratch using PyTorch
🤝 Open-Source & Community Contribution
Worked with an experiment codebase for imitation learning, contributed to the infrastructure side.
• jetspace-imitation-learning:
- Dataset Loading Optimization - Optimized dataset loading by implementing options-based selective NPZ decompression and adding fail-first guard clauses to skip invalid episodes early.
- Data Pipeline Refactor - Refactored data pipeline architecture by decoupling Episode into a standalone dataclass, upgrading EpisodeBuffer storage mechanics, and updating the demo collection script for compatibility.
- Reading theoretical whitepapers & engineering blogs
