Reading Group

This summer semester we are hosting a BLISSful AI reading group. Various BLISS members will present papers related to their research.
Time: Every Monday, 6:45pm
  1. Summer Semester 2023
  2. Meta-Learning the Inductive Biases of Simple Neural Circuits paper image
    Reading Group
    Meta-Learning the Inductive Biases of Simple Neural Circuits

    William Dorrell, Maria Yuffa, Peter Latham

  3. Dopamine and temporal difference learning - A fruitful relationship between neuroscience and AI paper image
    Reading Group
    Dopamine and temporal difference learning - A fruitful relationship between neuroscience and AI

    Will Dabney, Zeb Kurth-Nelson

  4. Pattern-Based Music Generation with Wasserstein Autoencoders and PRC Descriptions paper image
    Reading Group
    Pattern-Based Music Generation with Wasserstein Autoencoders and PRC Descriptions

    Valentijn Borghuis, Luca Angioloni, Lorenzo Brusci, Paolo Frasconi

  5. Bytes is all you need paper image
    Reading Group
    Bytes is all you need

    Maxwell Horton, Sachin Mehta, Ali Farhadi, Mohammad Rastegari

  6. Masked Autoencoders Are Scalable Vision Learners paper image
    Reading Group
    Masked Autoencoders Are Scalable Vision Learners

    Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár et al.

  7. Winter Semester 2023/24
  8. Human-level Control through Deep Reinforcement Learning paper image
    Reading Group
    Human-level Control through Deep Reinforcement Learning

    Volodymyr Mnih, K. Kavukcuoglu, David Silver, Andrei A. Rusu, J. Veness et al.

    Paper
  9. Dueling Network Architectures for Deep Reinforcement Learning paper image
    Reading Group
    Dueling Network Architectures for Deep Reinforcement Learning

    Ziyu Wang, Tom Schaul, Matteo Hessel, Hado van Hasselt, Marc Lanctot et al.

    Paper
  10. Deep Reinforcement Learning with Double Q-learning paper image
    Reading Group
    Deep Reinforcement Learning with Double Q-learning

    Hado van Hasselt, Arthur Guez, David Silver

    Paper
  11. Prioritized Experience Replay paper image
    Reading Group
    Prioritized Experience Replay

    Tom Schaul, John Quan, Ioannis Antonoglou, David Silver

    Paper
  12. A Distributional Perspective on Reinforcement Learning paper image
    Reading Group
    A Distributional Perspective on Reinforcement Learning

    Marc G. Bellemare, Will Dabney, Rémi Munos

    Paper
  13. Noisy Networks for Exploration paper image
    Reading Group
    Noisy Networks for Exploration

    Meire Fortunato, Mohammad Gheshlaghi Azar, Bilal Piot, Jacob Menick, Ian Osband et al.

    Paper
  14. Rainbow: Combining Improvements in Deep Reinforcement Learning paper image
    Reading Group
    Rainbow: Combining Improvements in Deep Reinforcement Learning

    Matteo Hessel, Joseph Modayil, Hado van Hasselt, Tom Schaul, Georg Ostrovski et al.

    Paper
  15. Agent57: Outperforming the Atari Human Benchmark paper image
    Reading Group
    Agent57: Outperforming the Atari Human Benchmark

    Adrià Puigdomènech Badia, Bilal Piot, Steven Kapturowski, Pablo Sprechmann, Alex Vitvitskyi et al.

    Paper
  16. RL-Duet - Online Music Accompaniment Generation Using Deep Reinforcement Learning paper image
    Reading Group
    RL-Duet - Online Music Accompaniment Generation Using Deep Reinforcement Learning

    Nan Jiang, Sheng Jin, Zhiyao Duan, Changshui Zhang

    Paper
  17. Neural Discrete Representation Learning paper image
    Reading Group
    Neural Discrete Representation Learning

    Aaron van den Oord, Oriol Vinyals, Koray Kavukcuoglu

    Paper
  18. Jukebox A Generative Model for Music paper image
    Reading Group
    Jukebox A Generative Model for Music

    Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford et al.

    Paper
  19. High Fidelity Neural Audio Compression paper image
    Reading Group
    High Fidelity Neural Audio Compression

    Alexandre Défossez, Jade Copet, Gabriel Synnaeve, Yossi Adi

    Paper
  20. MusicLM: Generating Music From Text paper image
    Reading Group
    MusicLM: Generating Music From Text

    Andrea Agostinelli, Timo I. Denk, Zalán Borsos, Jesse Engel, Mauro Verzetti et al.

    Paper
  21. MT3 Multi-Task Multitrack Music Transcription paper image
    Reading Group
    MT3 Multi-Task Multitrack Music Transcription

    Josh Gardner, Ian Simon, Ethan Manilow, Curtis Hawthorne, Jesse Engel

    Paper
  22. Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale paper image
    Reading Group
    Voicebox: Text-Guided Multilingual Universal Speech Generation at Scale

    Matthew Le, Apoorv Vyas, Bowen Shi, Brian Karrer, Leda Sari et al.

    Paper
  23. Summer Semester 2024
  24. Intriguing Properties of Contrastive Losses paper image
    Reading Group
    2 papers: Intriguing Properties of Contrastive Losses, Bootstrap your own latent: A new approach to self-supervised Learning

    Reading group session

  25. Emerging Properties in Self-Supervised Vision Transformers paper image
    Reading Group
    2 papers: Emerging Properties in Self-Supervised Vision Transformers, Vision Transformers Need Registers

    Reading group session

  26. Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture paper image
    Reading Group
    2 papers: Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture, What do Self Supervised Vision Transformers Learn?

    Reading group session

  27. Revealing the Dark Secrets of Masked Image Modeling paper image
    Reading Group
    2 papers: Revealing the Dark Secrets of Masked Image Modeling, Can We Break Free from Strong Data Augmentations in Self-Supervised Learning?

    Reading group session

  28. Stochastic Gradient Descend paper image
    Reading Group
    2 papers: Stochastic Gradient Descend, Adding Gradient Noise Improves Learning for Very Deep Networks

    Reading group session

  29. On the importance of initialization and momentum in deep learning paper image
    Reading Group
    2 papers: On the importance of initialization and momentum in deep learning, Adam: A Method for Stochastic Optimization

    Reading group session

  30. Natural Language Processing, Chapter 6 paper image
    Reading Group
    Natural Language Processing, Chapter 6

    Jacob Eisenstein

    Paper
  31. Formal Algorithms for Transformers paper image
    Reading Group
    Formal Algorithms for Transformers

    Mary Phuong, Marcus Hutter

    Paper
  32. Winter Semester 2024/25
  33. Language Models are Few-Shot Learners, Chapter 3 paper image
    Reading Group
    Language Models are Few-Shot Learners, Chapter 3

    Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan et al.

    Paper
  34. A Formal Perspective on Byte-Pair Encoding paper image
    Reading Group
    A Formal Perspective on Byte-Pair Encoding

    Vilém Zouhar, Clara Meister, Juan Luis Gastaldi, Li Du, Tim Vieira et al.

    Paper
  35. Training Compute-Optimal Large Language Models paper image
    Reading Group
    Training Compute-Optimal Large Language Models

    Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai et al.

    Paper
  36. Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism paper image
    Reading Group
    Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

    Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper et al.

    Paper
  37. Training language models to follow instructions with human feedback paper image
    Reading Group
    Training language models to follow instructions with human feedback

    Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright et al.

    Paper
  38. Training Language Models to Self-Correct via Reinforcement Learning paper image
    Reading Group
    Training Language Models to Self-Correct via Reinforcement Learning

    Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, Yi Su, JD Co-Reyes et al.

    Paper
  39. A Mathematical Framework for Transformer Circuits paper image
    Reading Group
    A Mathematical Framework for Transformer Circuits

    Nelson Elhage, Neel Nanda, Catherine Olsson, Tom Henighan†, Nicholas Joseph† et al.

    Paper
  40. Toy Models of Superposition paper image
    Reading Group
    Toy Models of Superposition

    Nelson Elhage, Tristan Hume, Catherine Olsson, Nicholas Schiefer, Tom Henighan et al.

    Paper
  41. Towards Monosemanticity: Decomposing Language Models With Dictionary Learning paper image
    Reading Group
    Towards Monosemanticity: Decomposing Language Models With Dictionary Learning

    Trenton Bricken, Adly Templeton, Joshua Batson, Brian Chen, Adam Jermyn et al.

    Paper
  42. Refusal in Language Models Is Mediated by a Single Direction paper image
    Reading Group
    Refusal in Language Models Is Mediated by a Single Direction

    Andy Arditi, Oscar Obeso, Aaquib Syed, Daniel Paleka, Nina Panickssery et al.

    Paper
  43. Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet paper image
    Reading Group
    Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet

    Adly Templeton, Tom Conerly, Jonathan Marcus, Jack Lindsey, Trenton Bricken et al.

    Paper
  44. Efficient Dictionary Learning with Switch Sparse Autoencoders paper image
    Reading Group
    Efficient Dictionary Learning with Switch Sparse Autoencoders

    Anish Mudide, Joshua Engels, Eric J. Michaud, Max Tegmark, Christian Schroeder de Witt

    Paper
  45. Monet: Mixture of Monosemantic Experts for Transformers paper image
    Reading Group
    Monet: Mixture of Monosemantic Experts for Transformers

    Jungwoo Park, Young Jin Ahn, Kee-Eung Kim, Jaewoo Kang

    Paper
  46. Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models paper image
    Reading Group
    Sparse Feature Circuits: Discovering and Editing Interpretable Causal Graphs in Language Models

    Samuel Marks, Can Rager, Eric J. Michaud, Yonatan Belinkov, David Bau et al.

    Paper
  47. Transcoders Find Interpretable LLM Feature Circuits paper image
    Reading Group
    Transcoders Find Interpretable LLM Feature Circuits

    Jacob Dunefsky, Philippe Chlenski, Neel Nanda

    Paper
  48. Interpretability in Parameter Space: Minimizing Mechanistic Description Length with Attribution-based Parameter Decomposition paper image
    Reading Group
    Interpretability in Parameter Space: Minimizing Mechanistic Description Length with Attribution-based Parameter Decomposition

    Dan Braun, Lucius Bushnaq, Stefan Heimersheim, Jake Mendel, Lee Sharkey

    Paper
  49. Summer Semester 2025
  50. A foundation model for clinical-grade computational pathology and rare cancers detection paper image
    Reading Group
    A foundation model for clinical-grade computational pathology and rare cancers detection

    Eugene Vorontsov, Alican Bozkurt, Adam Casson, George Shaikovski, Michal Zelechowski et al.

    Paper
  51. A visual-language foundation model for computational pathology paper image
    Reading Group
    A visual-language foundation model for computational pathology

    Ming Y. Lu, Bowen Chen, Drew F. K. Williamson, Richard J. Chen, Ivy Liang et al.

    Paper
  52. Transmil: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification paper image
    Reading Group
    Transmil: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification

    Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang et al.

    Paper
  53. A multimodal generative AI copilot for human pathology paper image
    Reading Group
    A multimodal generative AI copilot for human pathology

    Ming Y. Lu, Bowen Chen, Drew F. K. Williamson, Richard J. Chen, Melissa Zhao et al.

    Paper
  54. Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning paper image
    Reading Group
    Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning

    Richard J. Chen, Chengkuan Chen, Yicong Li, Tiffany Y. Chen, Andrew D. Trister et al.

    Paper
  55. PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathology paper image
    Reading Group
    PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathology

    George Shaikovski, Adam Casson, Kristen Severson, Eric Zimmermann, Yi Kan Wang et al.

    Paper
  56. Neural Message Passing for Quantum Chemistry paper image
    Reading Group
    Neural Message Passing for Quantum Chemistry

    Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, Oriol Vinyals, George E. Dahl

    Paper
  57. Directional Message Passing for Molecular Graphs paper image
    Reading Group
    Directional Message Passing for Molecular Graphs

    Johannes Gasteiger, Janek Groß, Stephan Günnemann

    Paper
  58. E(n) Equivariant Graph Neural Networks paper image
    Reading Group
    E(n) Equivariant Graph Neural Networks

    Victor Garcia Satorras, Emiel Hoogeboom, Max Welling

    Paper
  59. ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations paper image
    Reading Group
    ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations

    Weihua Hu, Muhammed Shuaibi, Abhishek Das, Siddharth Goyal, Anuroop Sriram et al.

    Paper
  60. On the Expressive Power of Geometric Graph Neural Networks paper image
    Reading Group
    On the Expressive Power of Geometric Graph Neural Networks

    Chaitanya K. Joshi, Cristian Bodnar, Simon V. Mathis, Taco Cohen, Pietro Liò

    Paper
  61. Winter Semester 2025/26
  62. U-Net: Convolutional Networks for Biomedical Image Segmentation paper image
    Reading Group
    U-Net: Convolutional Networks for Biomedical Image Segmentation

    Olaf Ronneberger, Philipp Fischer, Thomas Brox

    Paper
  63. Biologically Guided Variational Inference for Interpretable Multimodal Single-Cell Integration and Mechanistic Discovery paper image
    Reading Group
    Biologically Guided Variational Inference for Interpretable Multimodal Single-Cell Integration and Mechanistic Discovery

    Lucas Arnoldt, Julius Upmeier zu Belzen, Luis Herrmann, Khue Nguyen, Fabian Theis et al.

    Paper
  64. A foundation model for clinician-centered drug repurposing paper image
    Reading Group
    A foundation model for clinician-centered drug repurposing

    Kexin Huang, Payal Chandak, Qianwen Wang, Shreyas Havaldar, Akhil Vaid et al.

    Paper
  65. Large Language Models are Powerful Electronic Health Record Encoders paper image
    Reading Group
    Large Language Models are Powerful Electronic Health Record Encoders

    Stefan Hegselmann, Georg von Arnim, Tillmann Rheude, Noel Kronenberg, David Sontag et al.

    Paper
  66. JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Model paper image
    Reading Group
    JanusDNA: A Powerful Bi-directional Hybrid DNA Foundation Model

    Qihao Duan, Bingding Huang, Zhenqiao Song, Irina Lehmann, Lei Gu et al.

    Paper
  67. Beyond Sensor Data: Foundation Models of Behavioral Data from Wearables Improve Health Predictions paper image
    Reading Group
    Beyond Sensor Data: Foundation Models of Behavioral Data from Wearables Improve Health Predictions

    Eray Erturk, Fahad Kamran, Salar Abbaspourazad, Sean Jewell, Harsh Sharma et al.

    Paper
  68. Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities paper image
    Reading Group
    Contrasting with Symile: Simple Model-Agnostic Representation Learning for Unlimited Modalities

    Adriel Saporta, Aahlad Puli, Mark Goldstein, Rajesh Ranganath

    Paper
  69. Training Language Models to Follow Instructions with Human Feedback paper image
    Reading Group

    Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright et al.

  70. Constitutional AI: Harmlessness from AI Feedback paper image
    Reading Group

    Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion et al.

  71. Adversarial Training for High-Stakes Reliability paper image
    Reading Group

    Daniel M. Ziegler, Seraphina Nix, Lawrence Chan, Tim Bauman, Peter Schmidt-Nielsen et al.

  72. Goal Misgeneralization in Deep Reinforcement Learning paper image
    Reading Group

    Lauro Langosco, Jack Koch, Lee Sharkey, Jacob Pfau, Laurent Orseau et al.

  73. TruthfulQA: Measuring How Models Mimic Human Falsehoods paper image
    Reading Group

    Stephanie Lin, Jacob Hilton, Owain Evans

  74. Alignment Faking in Large Language Models paper image
    Reading Group

    Ryan Greenblatt, Carson Denison, Benjamin Wright, Fabien Roger, Monte MacDiarmid et al.

  75. Emergent Misalignment paper image
    Reading Group

    Jan Betley, Daniel Tan, Niels Warncke, Anna Sztyber-Betley, Xuchan Bao et al.

  76. Summer Semester 2026
  77. Persona Features Control Emergent Misalignment paper image
    Reading Group

    Miles Wang, Tom Dupre la Tour, Olivia Watkins, Aleksandar Makelov, Ryan Andrew Chi et al.

  78. Tell me about yourself: LLMs are aware of their learned behaviors paper image
    Reading Group

    Jan Betley, Xuchan Bao, Martín Soto, Anna Sztyber-Betley, James Chua et al.

  79. Getting aligned on representational alignment paper image
    Reading Group

    Ilia Sucholutsky, Lukas Muttenthaler, Adrian Weller, Andi Peng, Andreea Bobu et al.

  80. Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model paper image
    Reading Group

    Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, Laurent Sifre et al.

  81. Genie: Generative Interactive Environments paper image
    Reading Group

    Jake Bruce, Michael Dennis, Ashley Edwards, Jack Parker-Holder, Yuge Shi et al.

  82. How Far is Video Generation from World Model: A Physical Law Perspective paper image
    Next UpReading Group

    Bingyi Kang, Yang Yue, Rui Lu, Zhijie Lin, Yang Zhao et al.

  83. Dyslexify: A Mechanistic Defense Against Typographic Attacks in CLIP paper image
    Reading Group

    Lorenz Hufe, Constantin Venhoff, Erblina Purelku, Maximilian Dreyer, Sebastian Lapuschkin et al.

  84. TBD: Paper about Robotics paper image
    Reading Group
    TBD: Paper about Robotics

    TBD

    Paper
  85. TBD: Paper about Robotics paper image
    Reading Group
    TBD: Paper about Robotics

    TBD

    Paper
  86. TBD: Paper about Robotics paper image
    Reading Group
    TBD: Paper about Robotics

    TBD

    Paper