Implementing Algorithms for the Multi-Armed-Bandit ProblemLet's suppose you are faced with a dilemma; there are k possible actions to take, and you have only T opportunities to take actions. Taking an action returns a reward R from an underlying reward distrAug 1, 2026·18 min read
How Robots Navigate a Known World—Implementing Path Planning AlgorithmsIntroduction Navigating an unknown area uses an algorithm of its own; we can call that obstacle avoidance. But when the area has been mapped already (i.e., the robot has memory of the map of its environment), then the problem shifts from just avoidin...Jan 5, 2026·17 min read
The Art of Neural Networks: a mathematical deep diveThe origins: Neural Networks and the human brain Neural networks were inspired by the network of neurons and synapses in the biological brain. A biological neuron receives input from its dendrites, performs some operation on the inputs, and then fire...Nov 30, 2025·20 min read
Solving the Search and Sample Return ProblemA perfect problem to get started with in robotics is the Search and Sample Return task, where a rover must autonomously explore an unknown terrain, identify and collect rock samples, and return safely to its base once mapping is complete. Before goin...Nov 17, 2025·25 min read
AI foundations - Implementing machine learning models from scratchIt is relatively easy to use a machine learning model, all the math has been abstracted, and you can just call a function and add some parameters to train a model. You can achieve good results from using this plug and play method, you can apply multi...Oct 3, 2025·35 min read
Building the Software Behind a Hand-Gesture Controlled Drone for Mapping - 2This is part 2 of a 2-part series. In part one here, I discussed the motivation for the project, how gestures were recognized, the firmware behind the project (INav, but Ardupilot is better), and then finally the MSP-based drone control. That post fo...Sep 16, 2025·23 min read
Building the Software Behind a Hand-Gesture Controlled Drone for Mapping - 1Introduction I have always been fascinated by the idea of telekinesis; it would be nice to be able to move things with your mind. In the case of telekinesis, you move objects around with your mind. While controlling objects with the mind is still far...Sep 6, 2025·15 min read
