J-Space Hacking: Representational Reencoding Beyond the Verbalizable Workspace
September 2026 Ciara Rowles Preprint
#Interpretability #Activation Monitoring #Language Models

When a language model is instructed to suppress an internal state, the state is not erased — it is re-encoded into a basis that ordinary expression-aligned readouts miss. Targeted interventions separate decodability from output accessibility, showing how activation monitors trained in one behavioural regime can fail in another.

PDF
Stable-Layers: Fine-Tuning Image Layer Decomposition Models with VLM-Scored Reinforcement Learning
May 2026 Ciara Rowles, Reshinth Adithyan, Nikhil Pinnaparaju, Vikram Voleti, Mark Boss arXiv:2605.30257
#Layer Decomposition #Reinforcement Learning #Vision-Language Models

A reinforcement learning framework that refines layer decomposition models from vision-language model feedback instead of paired data. Flow-GRPO with LoRA samples candidate decompositions, and a two-stage scoring pipeline counters the tendency of VLMs to cluster their scores into a narrow band.

Foley Control: Aligning a Frozen Latent Text-to-Audio Model to Video
October 2025 Ciara Rowles, Varun Jampani, Simon Donné, Shimon Vainer, Julian Parker, Zach Evans arXiv:2510.21581
#Video-to-Audio #Foley #Generative Audio

A lightweight bridge for video-synchronised Foley that leaves both pretrained models frozen. V-JEPA2 video embeddings enter Stable Audio Open through compact cross-attention placed after the existing text cross-attention, so prompts set global semantics while video refines timing and local dynamics.

IPAdapter-Instruct: Resolving Ambiguity in Image-based Conditioning using Instruct Prompts
August 2024 Ciara Rowles, Shimon Vainer, Dante De Nigris, Slava Elizarov, Konstantin Kutsy, Simon Donné arXiv:2408.03209
#Diffusion Models #Conditioning #Multi-Task Learning

Image conditioning is ambiguous: the same reference image can mean style transfer, object extraction, or something else again. Pairing natural-image conditioning with "Instruct" prompts lets one model switch between those interpretations, learning several tasks at once with little quality loss against dedicated single-purpose models.