Skip to content
View Johnnykoch02's full-sized avatar
🤖
Programmin'
🤖
Programmin'

Organizations

@theCoderSchoolTampa @USF-IEEE

Block or report Johnnykoch02

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Johnnykoch02/README.md

Below is an updated version of your professional overview, incorporating the latest details from your new resume. Feel free to adjust the content and formatting as you see fit.


Jonathan Koch – AI Software Engineer

Hello! I’m Jonathan Koch, a driven Software Engineer and AI Researcher with broad experience in both academic and industry settings. I’m passionate about Robotics, AI, and leveraging cutting-edge techniques—like LLM fine-tuning, contrastive learning, and multi-modal data processing—to tackle real-world challenges. My work spans from developing advanced object manipulation algorithms to designing high-impact ML solutions for image/video enhancement and job-search engines. Outside of tech, you can find me playing acoustic guitar, piano, or training in Brazilian Jiu-Jitsu.


Overview

  • Languages: Python, C/C++, DJ (Diminished Java), C#, Java, RISC-V, Julia, Lua, JavaScript, Rust, Perl, R, CUDA
  • Competencies: ROS, Actor-Critic, PyTorch, NumPy, Pandas, ONNX, CoreML, Linux, Networking, 2D & 3D Physics/Simulation Engines, LLM Fine-Tuning, Prompt Engineering, Multi-Modal Data Processing, Semantic & Generative Models, Self-Supervised Learning, Compilers
  • Research Background: Robotics (Object Manipulation, Perception Modeling, Reinforcement Learning, Model Predictive Control, Reward Tuning, Variational Autoencoders), NLP (Semantic Search, Text-Based Recommendation Systems, Multi-Modal Search), Audio & Image Processing (Quality Assessment, Enhancement, Segmentation)
  • Interests: Predictive Models, Multi-Agent Learning, Underactuated Robotics, Self-Supervised Learning, Cognitive Science, Data Science, MIT OpenCourseWare, Acoustic Guitar, Piano, BJJ
  • Personal Website: Jonathanzkoch.dev

Education

Bachelor of Science in Computer Science, Concentration in Robotics and AI
University of South Florida College of Engineering (Fall 2020 – Spring 2024)

  • Engineering GPA: 3.7/4.0

Experience

Co-Founder / AI Engineer – Joby AI (HireBase.org)

November 2023 – Present | Tampa, FL

  • Enhanced core value proposition of a job board through data-driven matching, streamlined processes, and scalable ML pipelines.
  • Contrastively fine-tuned vector search models on real and synthetic user data (job candidates) to improve relevance and discoverability of job postings, leveraged Matroskya representation learning to get low dimensional vector search and keeping comparison FLOPs as low as possible for speed.
  • Leveraged LLM agents to scrape over 30k jobs daily from 12k+ career pages and boards; automated application workflows for users, boosting premium revenue and user engagement.
  • Reduced LLM inference costs and enhanced pipeline efficiency, cutting scraping costs by 43% and speeding daily scrapes by 2.76×.
  • Delivering advanced ML features to serve 20k+ monthly active users in pursuit of the ideal career match.

ML Engineer – Topaz Labs (TopazLabs.com)

June 2024 – Present | Addison, TX

  • Designed, trained, and integrated ML models for quality assessment, segmentation, semantic analysis, and enhancement of images/videos.
  • Architected a zero-click enhancement pipeline for cloud API users, allowing dynamic multi-step processing and incremental quality checks.
  • Built internal tools for large-scale data analysis, checkpoint comparisons, and streamlined R&D workflows.
  • Implemented user data tracking to develop suggestion and autopilot tools, reducing average clicks per export session from 21.8 to 3.6.
  • Led iOS app ML integration (CoreML) for 100k+ monthly users, debugging edge cases across multiple iPhone hardware versions.
  • Deployed automated conversion-failure detection using a high-precision classification pipeline to maintain model quality across ONNX, CoreML, TensorRT, and OpenVINO conversions.

Research Scientist – Robot Perception and Action Laboratory (USF)

Fall 2021 – Present | Tampa, FL

  • Investigated robotic object manipulation with supervised and reinforcement learning, focusing on transformer-based perception and policy optimization.
  • Explored graph neural networks and transformers to model dynamic relationships between states and actions.
  • Leveraged contrastive divergence in latent space conditioning on actions to improve predictive accuracy and representation quality.
  • Developed heuristic approaches based on physics-inspired predictive models, enabling more robust grasping strategies without reliance on large-scale RL data.

ML Engineering Co-Op – CAE USA

November 2023 – May 2024 | Tampa, FL

  • Prototyped a Generative Agents architecture using large language models capable of reasoning and explainable action steering in simulations.
  • Deployed contrastive learning for text classification, boosting accuracy from 93% to 99%.
  • Created training tools to mitigate overfitting by generating structured but semantically varied data to strengthen model robustness.

Software Engineering Co-Op – CAE USA

May 2022 – November 2023 | Tampa, FL

  • Developed Windows and Linux lab nodes for parallel simulation hardware, collaborating with embedded teams to process sensor data in real-time.
  • Integrated repositories into CI/CD pipelines and tackled a wide range of R&D projects, including multi-screen touchscreen driver development and advanced MLOps integrations.

Projects

  • IEEE Open-Source Robotics Software Stack
    GitHub

    • Facilitated autonomous capabilities (perception, SLAM, and planning) with distributed computation across multiple devices.
    • Modeled environmental dynamics and latent state representations for RL and behavior cloning on Jetson hardware.
  • Teach-A-Bull (AI Tutor)
    GitHub | Competition Video

    • Leveraged LLMs to generate multi-layered educational content (lessons, homework, schedules).
    • Achieved a 10× decrease in SAT/ACT prep costs and a high similarity to expert-curated content.
  • MicroGradPlus
    GitHub

    • A lightweight computational graph / auto-differentiation API using only NumPy, inspired by Karpathy’s Micrograd.
    • Achieved 94% accuracy on MNIST and perfectly matched PyTorch gradients on vector tests.
  • CoderSchoolAI
    GitHub | Demo

    • A beginner-friendly neural network and AI tools library for educational purposes.
    • Simplified ML modeling for novice learners and kids by providing black-box design for data-driven tasks.
  • Virtual Assistant
    GitHub

    • An NLP-based assistant for task sequencing.
    • Processes natural language commands to actionable steps.

Contact


I take pride in creating robust, elegant solutions—whether it’s designing complex robotics systems or building user-centric AI experiences. My curiosity drives me to constantly learn, refine my craft, and push the boundaries of what AI can do.

Pinned Loading

  1. ChessEngine ChessEngine Public

    This is a chess engine I am currently working on at theCoderSchool with one of my students. This engine when finished will provide a full chess experience and pit you against an AI system.

    Python 2 1

  2. V5 V5 Public

    PROS Perdue Project for USF BullBots

    C++ 5

  3. VirtualAssistant VirtualAssistant Public

    Jupyter Notebook 2

  4. Resume Resume Public

    This is my Resume :D

    2

  5. Jetson Jetson Public

    Robotic Subsystem Optimized for Computer Vision on NVIDA's Jetson Nano, and developed to pair with the V5 Brain of the TerriBull VEXU Robotics Team.

    Python 2

  6. USF-HackaBull-2023 USF-HackaBull-2023 Public

    Python