Chronological feed of everything captured from __ishaan.
paper / __ishaan / Jun 11
EvalCards is proposed as an operational layer to standardize AI evaluation reporting, addressing inconsistencies across various platforms by integrating benchmark metadata, evaluation data, and model information into a unified record. It establishes a schema derived from literature and interviews, incorporating signals for reproducibility, documentation, provenance, and comparability, and presents findings through reader modes tailored for different audiences. A deployed monitoring tool has analyzed a large corpus of AI models and results, identifying systematic reporting deficiencies.
ai-evaluationmodel-reportinginterpretabilitystandardizationbenchmark-metadata
“AI evaluation results are currently reported inconsistently across various platforms, hindering reliable comparison and traceability”
paper / __ishaan / Jun 10
This paper introduces a generative flow matching technique to address the limitations of hydrodynamic models, such as the regularized Dean-Kawasaki equation, in capturing non-Markovian and non-Gaussian dynamics in stochastic particle systems. The proposed method directly models flux distributions from simulations, improving accuracy in short-time dynamics and statistical moment predictions, as demonstrated in the Kramers first passage time problem for Brownian particles.
flow-matchingnon-markovian-dynamicsstochastic-systemsgenerative-modelsstatistical-mechanicscomputational-physics
“Hydrodynamic models like the regularized Dean-Kawasaki (DK) equation fail to accurately capture the short-time dynamics of stochastic particle systems due to non-Markovian effects and highly non-Gaussian distributions in low particle density regimes.”
paper / __ishaan / Jun 10
The SWE-Marathon benchmark introduces 20 long-horizon software engineering tasks designed to evaluate AI agents' capabilities in planning, long-context understanding, and memory over extended workflows (averaging 27.2M tokens). Current frontier agents fail over 70% of these tasks, demonstrating limitations in areas such as self-verification and task completion. The benchmark also highlights issues like reward hacking and premature termination, necessitating more robust agent designs for complex, real-world software development scenarios.
ai-agentslong-horizon-taskssoftware-engineeringbenchmarkllm-evaluation
“Current AI agents struggle to complete long-horizon software engineering tasks, with frontier agents solving fewer than 30% of tasks in the SWE-Marathon benchmark.”
paper / __ishaan / Jun 10
MilliVid introduces a hierarchical token-based approach to address the long-range consistency challenge in video generation. By leveraging a multi-scale token space and a coarse-to-fine rollout strategy within a diffusion model, it effectively maintains geometric and object permanence over extended sequences. This method compresses frames into hierarchical latents, allowing the model to focus computational resources on generating semantically important details while preserving overall consistency, outperforming prior baselines on long-form video generation tasks.
video-generationlong-range-consistencydiffusion-modelshierarchical-latentscomputer-visionmachine-learning
“Video generation models struggle with long-range consistency due to the prohibitively long sequence lengths required by transformers.”
paper / __ishaan / Jun 10
This work introduces GenEyePose, a novel patient-free, synthetic data generation pipeline for saccadic eye movement modeling. A deep learning classifier trained on this synthetic data demonstrated generalizability to real-world clinical data, achieving an AUROC of 0.76 and sensitivity of 0.71 for distinguishing normal from abnormal saccades. This approach holds promise for developing AI-enabled digital biomarkers for neurophysiologic screening and localization, overcoming limitations of current methods due to privacy concerns and scarce datasets.
ai-biomarkerssaccadic-eye-movementsneurophysiologysynthetic-datadeep-learningcomputer-vision
“A patient-free, synthetic multimodal eye movement generation pipeline can be used to create generalizable saccade analysis models.”
paper / __ishaan / Jun 6 / failed
paper / __ishaan / May 19 / failed
paper / __ishaan / May 19
TinySDP is the first SDP solver architected for embedded systems, enabling real-time MPC with nonconvex obstacle constraints on microcontrollers — a class of hardware previously considered too resource-constrained for SDP. The solver combines PSD cone projections with a cached-Riccati ADMM formulation to exploit computational structure, and pairs this with a rank-1 a posteriori certificate that converts relaxed solutions into hard geometric guarantees per timestep. Validated on a Crazyflie quadrotor, TinySDP demonstrates that convex relaxations of nonconvex geometry can be enforced at control-loop rates, closing a longstanding gap between SDP-based planning theory and embedded deployment.
semidefinite-programmingmotion-planningembedded-systemsmodel-predictive-controlconvex-optimizationedge-roboticsobstacle-avoidance
“TinySDP is the first SDP solver designed specifically for embedded systems, enabling real-time SDP-based MPC on microcontrollers.”
paper / __ishaan / May 13 / failed
paper / __ishaan / May 13 / failed
paper / __ishaan / May 13 / failed
paper / __ishaan / May 13 / failed
paper / __ishaan / May 13 / failed