Mathematical Logic

Linguistics, Music


Art, Artists

Web Design

Poets, Poetry



What Is Enlightenment? -Immanuel Kant

The Emotional Dog and Its Rational Tail: A Social Intuitionist Approach to Moral Judgment (2001) -Jonathan Haidt

Dilemmas in a General Theory of Planning (1973) -Horst W. J. Rittel, Melvin M. Webber

Information Foraging Theory (2007) -Peter Pirolli

Fair Source License (osi entry)

The Educated Mind: How Cognitive Tools Shape Our Understanding (1998) -Kieran Egan

Recurse Center - residents

EFF’s Patent Busting project

Intellectual Property and the Employee Engineer (2001) -Orin E. Laney

Ending World Hunger. The Promise of Biotechnology and the Threat of Antiscience Zealotry -Norman E. Borlaug (review)

Passion Projects - cultures: Lambda Ladies vs TTPL meetup

Why Most Published Research Findings Are False -John P. A. Ioannidis

Nature special issue on reproducibility

Data Portraits: Connecting People of Opposing Views -Eduardo Graells-Garrido, Mounia Lalmas, Daniele Quercia

Self-organized development in libre software projects: a model based on the stigmergy concept -Gregorio Robles, Juan Julian Merelo, Jesus M. Gonzalez-Barahona

Stigmergy and Implicit Coordination in Software Development -James Howison, Carsten Østerlund, Kevin Crowston, Francesco Bolici

Extended Stigmergy in Collective Construction -Justin Werfel, Radhika Nagpal

From local actions to global tasks: stigmergy and collective robotics -R. Beckers, O.E. Holland, J.L. Deneubourg

Stigmergy, self-organisation, and sorting in collective robotics -Owen Holland, Chris Melhuish

Micromotives and Macrobehavior -Thomas Schelling

Reasonable Person Principle

Big Data: A Tool for Inclusion or Exclusion? (conference recordings)

Algorithms and Accountability (conference recordings)

Inequality for all -Richard Reich

Proust and the Squid -Maryanne Wolf

How Complex Systems Fail -Richard I. Cook, MD (video)

A History of the English Langauge -Michael D.C. Trout - audio

Debt: The First 5000 Years -David Graeber

Guns, Germs, and Steel -Jared Diamond

Here Comes Everybody -Clay Shirky

Cognitive Surplus -Clay Shirky

Unskilled and Unaware of It -Justin Kruger, David Dunning

Why the Climate Corporation sold itself to Monsanto -Michael Specter

“I’ve Got Nothing to Hide” and Other Misunderstandings of Privacy -Daniel Solove, discussion

The re-tooled mind: how culture re-engineers cognition

Six views of embodied cognition -Margaret Wilson

How Did We Get from There to Here? An Evolutionary Perspective on Embodied Cognition

Incognito: The Secret Lives of the Brain -David Eagleman


Media Exposure through the Funnel: A Model of Multi-Stage Attribution (2012) -Vibhanshu Abhishek, Peter S. Fader, Kartik Hosanagar

VA VA Voom: Variable annuities … -Oliver Wyman

Theory of Constraints

China Fortunes -John Kuhns (interview)

The Goal -Eliyahu M. Goldratt

Masters of Enterprise -H. W. Brands

Mountains beyond mountains (about Paul Farmer) -Tracy Kidder

Dealers of Lightning: Xerox PARC and the Dawn of the Computer Age -Michael A. Hiltzik

The Five Dysfunctions of a Team -Patrick Lencioni

The Idea Factory: Bell Labs and the Great Age of American Innovation -Jon Gertner

The Catbird Seat -James Thurber


Structured Prediction Models via the Matrix-Tree Theorem (2007) -Terry Koo, Amir Globerson, Xavier Carreras, Michael Collins

Generating Random Spanning Trees via Fast Matrix Multiplication (2016) -Nicholas J. A. Harvey and Keyulu Xu (talk)

Sampling Random Spanning Trees Faster than Matrix Multiplication (2016) -David Durfee, Rasmus Kyng, John Peebles, Anup B. Rao, Sushant Sachdeva

TensorLog: A Differentiable Deductive Database (2016) -William W. Cohen

A Nanopass Framework for Compiler Education (2005) -Dipanwita Sarkar, Oscar Waddell, R. Kent Dybvig

A Multicore Path to Connectomics-on-Demand (2017) -Alexander Matveev, Yaron Meirovitch, Hayk Saribekyan

A Fast Abstract Syntax Tree Interpreter for R (2014) -Tomas Kalibera, Petr Maj, Floreal Morandat, Jan Vitek (code, evolved to fastR)

Evaluating the Design of the R Language (2012) -Floreal Morandat, Brandon Hill, Leo Osvald, Jan Vitek (slides, code)

Satisfiability Modulo Theories (2008) -Clark Barrett, Roberto Sebastiani, Sanjit A. Seshia and Cesare Tinelli

Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers (2010) -Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein

Practical Graph Isomorphism II (2013) -Brendan McKay, Adolfo Piperno

Graph Isomorphism: László Babai's 2015 result and 2017 revision, Jeremy Kun’s exposition

Preparing for the future of artificial intelligence (2016) -Obama’s office (blogpost)

Belief-Propagation for Weighted b-Matchings on Arbitrary Graphs and its Relation to Linear Programs with Integer Solutions (2011) -Mohsen Bayati, Christian Borgs, Jennifer Chayes, Riccardo Zecchina

Simulating Physics with Computers (1982) -Richard P. Feynman

Hitchhiker’s Tour of the BEAM (Erlang’s virtual machine) (2012) -Robert Virding

Probabilistic Databases (2011) -Dan Suciu, Dan Olteanu, Christopher Ré, Christoph Koch (book)

Two Simplified Algorithms for Maintaining Order in a List (2002) -Michael A. Bender, Richard Cole, Erik D. Demaine, Martin Farach-Colton, Jack Zito

Reviving the fifth generation project: building the ultimate rules engine (2008) -Gopal Gupta

Functional Programs that Explain their Work (2012) -Roly Perera, Umut A. Acar, Paul Blain Levy, James Cheney

Lara: A Key-Value Algebra underlying Arrays and Relations (2016) -Dylan Hutchison, Bill Howe, Dan Suciu

Layout Randomization and Nondeterminism (2014) -M Abadi, J Planul, GD Plotkin

Fast Linear Solvers for Laplacian Systems (2013) -Olivia Simpson (survey)

Small memory software: patterns for systems with limited memory (2000) -Charles Weir and James Noble 

Learning Regular Sets from Queries and Counterexamples (1987) -Dana Angluin

A Maintenance Programmer’s View of GCC (2003) -Zachary Weinberg

Erlang in Anger (pdf) (2014) -Fred Hebert

Certifying Algorithms (2011) -R. M. McConnella, K. Mehlhornb, S. N¨aherc, P. Schweitzer (slides)

Readings in Database Systems, 5th Edition -Peter Bailis, Joseph M. Hellerstein, Michael Stonebraker, editors

No compromises: distributed transactions with consistency, availability, and performance (2015) -Aleksandar Dragojevic, Dushyanth Narayanan, Edmund B. Nightingale, Matthew Renzelmann, Alex Shamis, Anirudh Badam, Miguel Castro

Metaheuristics: Theory and Applications, Advances and Trends, Essays and surveys in (2012)

Scalable Influence Maximization for Prevalent Viral Marketing in Large-Scale Social Networks (2010) -Wei Chen, Chi Wang, Yajun Wang

Maximizing the Spread of Influence through a Social Network (2003) -David Kempe, Jon Kleinberg, Eva Tardos

Purely functional lazy nondeterministic programming (2011) -Sebastian Fischer, Oleg Kiselyov, Chung-Chieh Shan

Combining AFL and QuickCheck for directed fuzzing (2015) -Dan Luu

Mastering the game of Go with deep neural networks and tree search (2016) -David Silver, et al.

Dynamic Memory Balancing for Virtual Machines (2009) -Weiming Zhao, Zhenlin Wang

Programming by optimization (2012) -HH Hoos (slides)

A History of Haskell: being lazy with class (2007) -Paul Hudak, John Hughes, Simon Peyton Jones, Philip Wadler

Neural Turing Machines (2014) -Alex Graves, Greg Wayne, Ivo Danihelka

Comprehensive Formal Verification of an OS Microkernel (2014) -Gerwin Klein, June Andronick, Kevin Elphinstone, Toby Murray, Thomas Sewell, Rafal Kolanski, Gernot Heiser

Mathematically Verified Software Kernels: Raising the Bar for High Assurance Implementations (2014) -Daniel Potts, Rene Bourquin, Leslie Andresen, June Andronick, Gerwin Klein, Gernot Heiser

Modern C (2015) -Jens Gustedt (discussion)

Boosting distributed constraint satisfaction (2008) -Youssef Hamadi, Georg Ringwelski

RANDOMIZED BACKTRACK SEARCH Extending the reach of complete search methods (2004) -Carla P. Gomes

As We May Think (1945) -Vannevar Bush

Multi-probe consistent hashing (2015) -Ben Appleton, Michael O'Reilly

Your Server as a Function (2013) -Marius Eriksen

PowerGraph: Distributed Graph-Parallel Computation on Natural Graphs (2012) -Joseph E. Gonzalez, Yucheng Low, Haijie Gu, Danny Bickson, Carlos Guestrin

Functional Pearl: A SQL to C Compiler in 500 Lines of Code (2015) -Tiark Rompf, Nada Amin

Towards the Industrial Scale Development of Custom Static Analyzers (2006) -John Anton, Eric Bush, Allen Goldberg, Klaus Havelund, Doug Smith, Arnaud Venet

Toward the Synthesis of Constraint Solvers (2013) -Douglas R. Smith, Stephen J. Westfold

Biconjugate gradient stabilized method (BiCGSTAB)

The DCI Architecture: A New Vision of Object-Oriented Programming (2009) -Trygve Reenskaug, James O. Coplien

Data, context and interaction

Probabilistic Databases: Diamonds in the Dirt (2008) -Nilesh Dalvi, Christopher Ré, Dan Suciu

Cloud Types for Eventual Consistency (2012) -Sebastian Burckhardt, Manuel F¨ahndrich, Daan Leijen, and Benjamin P. Wood

Software Systems through Complex Networks Science: Review, Analysis and Applications (2012) -Lovro Šubelj, Marko Bajec

Join Processing for Graph Patterns: An Old Dog with New Tricks (2015) -Dung Nguyen, Molham Aref, Martin Bravenboer, George Kollias, Hung Q. Ngo, Christopher Ré, Atri Rudra

miniKanren: an embedded Domain Specific Language for logic programming

FlumeJava: Easy, Efficient Data-Parallel Pipelines (2010) -Craig Chambers, Ashish Raniwala, Frances Perry, Stephen Adams, Robert R. Henry, Robert Bradshaw, Nathan Weizenbaum

Probabilistic Constraint Handling Rules (2002) -Thom Fruhwirth, Alessandra Di Pierro, Herbert Wiklicky

Constraint Logic Programming (2010) -Marco Gavanelli, Francesca Rossi

Kestrel Institute: projects, people - Kestrel Technology: papers

A Very Gentle Introduction to Relational Programming (2013) -David Nolen

International Conference on Live Coding (2015) (proceedings)

A Perspective on the Evolution of Live Programming (2013) -Steven L. Tanimoto

SPARQL query answering with bitmap indexes (2012) -Julien Leblay

Computer Systems A Programmer’s Perspective (2011) -Randal E. Bryant, David R. O’Hallaron

Diamond: A SPARQL Query Engine, for Linked Data Based on the Rete Match (2012) -Daniel P. Miranker, Rodolfo K. Depena, Hyunjoon Jung, Juan F. Sequeda and Carlos Reyna

Pregel: A System for Large-Scale Graph Processing (2010) -Grzegorz Malewicz, Matthew H. Austern, Aart J. C. Bik, James C. Dehnert, Ilan Horn, Naty Leiser, and Grzegorz Czajkowski

VIDRE – A Distributed Service-Oriented Business Rule Engine based on RuleML (2006) -Christoph Nagl, Florian Rosenberg, Schahram Dustdar

In Search of an Understandable Consensus Algorithm (2014) -Diego Ongaro and John Ousterhout (Raft algorithm)

Understanding the Linux Virtual Memory Manager (2007) -Mel Gorman

An Efficient Compression Scheme For Bitmap Indices (2004) -Kesheng Wu, Ekow J. Otoo and Arie Shoshani

Compressing bitmap indexes for faster search operations (2002) -K Wu, EJ Otoo, A Shoshani

Scalable K-Means by Ranked Retrieval (2014) -Andrei Broder, Lluis Garcia-Pueyo, Vanja Josifovski, Sergei Vassilvitskii, Srihari Venkatesan

Processing Big Data Graphs on Memory-Restricted Systems (2014) -Harshvardhan, Nancy M. Amato, Lawrence Rauchwerger

Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion (2014) -Xin Luna Dong, Evgeniy Gabrilovich, Geremy Heitz, Wilko Horn, Ni Lao, Kevin Murphy, Thomas Strohmann, Shaohua Sun, Wei Zhang

PROGRAM-ing Finger Trees in COQ (2007) -Matthieu Sozeau

Running Probabilistic Programs Backwards (2014) -Neil Toronto, Jay McCarthy, David Van Horn

Machine Learning: The High-Interest Credit Card of Technical Debt (2014) -D. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Todd Phillips, Dietmar Ebner, Vinay Chaudhary, Michael Young

An abstract Monte-Carlo method for the analysis of probabilistic programs -David Monniaux

Aligning Development Tools with the Way Programmers Think About Code Changes (2007) -Marat Boshernitsan, Susan L. Graham, Marti A. Hearst

Static Analysis for Probabilistic Programs: Inferring Whole Program Properties from Finitely Many Paths (2013) -Sriram Sankaranarayanan, Aleksandar Chakarov, Sumit Gulwani

A unified view of generative models for networks: models, methods, opportunities, and challenges -Abigail Z. Jacobs, Aaron Clauset

Structured Generative Models of Natural Source Code (2014) -Chris J. Maddison, Daniel Tarlow

Trustworthy, Useful Languages for Probabilistic Modeling and Inference (thesis) -Neil Toronto

Programming with Angelic Nondeterminism (2010) -Shaon Barman, Rastislav Bodík, Satish Chandra, Joel Galenson, Doug Kimelman, Casey Rodarmor, Nicholas Tung

From Program Verification to Program Synthesis (2010) -Saurabh Srivastava, Sumit Gulwani, Jeffrey S. Foster

Modular Synthesis of Sketches using Models (2014) -Rohit Singh, Rishabh Singh, Zhilei Xu, Rebecca Krosnick, Armando Solar-Lezama

Program Synthesis by Sketching (2008) (PhD thesis) -Armando Solar-Lezama

Idris, a General Purpose Dependently Typed Programming Language: Design and Implementation -Edwin Brady

Structure and Efficiency of Computer Programs -Robert Harper (blogpost)

Toward Type-Directed Editing for Idris -Edward Amsden, Ryan Newton, Jeremy Siek

Parallel and Distributed Algorithms for Inference and Optimization (Simons workshop)

Luca Cardelli Festschrift

Patrick Cousot’s MIT course in Abstract Interpretation

David Schmidt’s Short course on Abstract interpretation and static analysis

Stack Computers: the new wave -Philip J. Koopman Jr.

My history of Forth & stack machines -Yossi Kreinin

The statistical mechanics of complex product development - related papers

Parquet - Dremel’s striping and assembly algorithms - as used in Parquet

CBOR = Concise Binary Object Representation

The cognitive dynamics of computer science -Szabolics Michael de Gyurky

ITConversations: Jon Udell’s interviews with innovators audio series

Datalog Programs and Their Stable Models Vladimir Lifschitz

What You Always Wanted to Know About Datalog (And Never Dared to Ask) -Sefano Ceri, Georg Gottlob, Letizia Tanca

Disjunctive Datalog -Thomas Eiter, Georg Gottlob, Heikki Manilla

The Computational Structure of Monotone Monadic SNP and Constraint Satisfaction: A Study through Datalog and Group Theory -Tomas Feder, Moshe Y. Vardi
Optimizing Datalog Programs -Yehoshua Sagiv

Scaling Datalog for Machine Learning on Big Data -Yingyi Bu, Vinayak Borkar, Michael J. Carey

Datalog Extensions for Database Queries and Updates -Serge Abiteboul, Victor Vianu

DL+log: Tight Integration of Description Logics and Disjunctive Datalog -Riccardo Rosati

Dedalus: Datalog in Time and Space -Peter Alvaro, William Marczak, Neil Conway, Joseph M. Hellerstein, David Maier and Russell C Sears

A Small Matter of Programming -Bonnie A. Nardi

History of Lossless Data Compression Algorithms

Type Soundness and Race Freedom for Mezzo -Thibaut Balabonski, François Pottier, and Jonathan Protzenko

Hints for Computer System Design -Butler W. Lampson

John Regehr's Papers (static analysis, compiler fuzzing)

Programming with Managed Time -Sean McDirmid, Jonathan Edwards

Data Workflows for Machine Learning -Paco Nathan

Interview with Paco Nathan

History of Databases -Stephen Fortune

ASTLOG: A Language for Examining Abstract Syntax Trees -Roger F. Crew (1997)

CodeQuest: Querying Source Code with DataLog -Elnar Hajiyev, Mathieu Verbaere, Oege de Moor, Kris de Volder (2005)

Collabode - collaborative coding in the browser -Max Goldman, Greg Little, Robert C. Miller

Software Development with Real-Time Collaborative Editing -Max Goldman

Authenticated Data Structures, Generically -Andrew Miller, Michael Hicks, Jonathan Katz, and Elaine Shi

Bias-Variance Tradeoffs in Program Analysis -Rahul Sharma, Aditya V. Nori, Alex Aiken

What are the fundamental structures of concurrency? We still don’t know! -Samson Abramsky

A Microkernel Architecture for Constraint Programming -Laurent Michel, Pascal Van Hentenryck

POPL14 papers

Principles of Model Checking -Christel Baier, Joost-Pieter Katoen, Kim Guldstrand Larsen

Programming in the Pi-Calculus: A Tutorial Introduction to Tamed Pict -Benjamin C. Pierce

The Next 700 Programming Languages -P. J. Landin

The IDE as a Value -Chris Granger (re lightable design)

Formal Analysis of a Distributed Algorithm for Tracking Progress -M. Abadi, F. McSherry, D. Murray, T. Rodeheffer

Naiad: A Timely Dataflow System -D. Murray, F. McSherry, R. Isaacs, M. Isard, P. Barham, M. Abadi

Differential dataflow -Frank McSherry Derek G. Murray Rebecca Isaacs Michael Isard

REX: Recursive, Delta-Based Data-Centric Computation -S. Mihaylov, Z. Ives, S. Guha

Figaro: An Object-Oriented Probabilistic Programming Language -Avi Pfeffer

Semantics, Abstract Interpretation, and Reasoning about Programs: Essays Dedicated to David A. Schmidt

The Balancing Act of Choosing Nonblocking Features - discussion

The Log-Structured Merge-Tree (LSM-Tree)

Views: Compositional Reasoning for Concurrent Programs

Advanced Automata Minimization -Lorenzo Clemente, Richard Mayr

Towards High-Throughput Gibbs Sampling at Scale: A Study across Storage Managers

Using Inhabitation in Bounded Combinatory Logic with Intersection Types for Composition Synthesis

Classic papers, curated by Jonathan Aldrich

lambda-JS: the essence of javascript - github - blogpost - LTU

Fully Abstract Compilation to Javascript

Matching with our eyes closed -Gagan Goel, Pushkar Tripathi

Online Matching with Stochastic Rewards -Aranyak Mehta, Debmalya Panigrahi

Simultaneous Approximations for Adversarial and Stochastic Online Budgeted Allocation -Mirrokni, Gharan, Zadimoghaddam

Large Scale Distributed Deep Networks -Jeffrey Dean, et al

VPRI papers

Recent Research of Guy Blelloch, eg Beyond Nested Parallelism

On the naturalness of software

Scalable Statistical Bug Isolation

Introduction to software architecture

Geometric Algebra - Geometric Algebra for Computer Scientists

A new approach to the functional design of a digital computer -R. S. Barton (1961)

λ-Calculus: The Other Turing Machine (2015) -Guy Blelloch, Robert Harper

Code is not literature (2014) -Peter Sieber

The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing (2015) -Tyler Akidau, Robert Bradshaw, Craig Chambers, Slava Chernyak, Rafael J. Fernandez-Moctezuma, Reuven Lax, Sam McVeety, Daniel Mills, Frances Perry, Eric Schmidt, Sam Whittle

Distributed Systems and the End of the API (2014) -Chas Emerick (hn discussion)

Logic and Lattices for Distributed Programming (2012) -Neil Conway, William Marczak, Peter Alvaro, Joseph M. Hellerstein, David Maier

Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing (2012) -Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael J. Franklin, Scott Shenker, Ion Stoica

LogiQL: a Declarative Language for Enterprise Applications (2015) -Todd J. Green

µKanren: A Minimal Functional Core for Relational Programming (2013) -Jason Hemann, Daniel P. Friedman

Termites and Telescopes (1979) -Philip Morrison

KLA: A New Algorithmic Paradigm for Parallel Graph. Computations -Harshvardhan, Adam Fidel, Nancy M. Amato, Lawrence Rauchwerger

Editing Functional Programs Without Breaking Them -Edward Amsden, Ryan Newton, Jeremy Siek

Programming Isn't Math -Oscar Boykin (video)

A conversation with Steve Burbeck about multicellular computing: podcast - transcript

Evolutionary Database Design -Martin Fowler, Pramod Sadalage

Towards User-Friendly Projectional Editors -Markus Voelter, Janet Siegmund, Thorsten Berger, and Bernd Kolb

Trillions -Peter Lucas, Joe Ballay, and Mickey McManus of Maya Design

We’re doing it all wrong -Paul Phillips (on forking Scala) - on hn - on ltu

An editor for composed programs -Laurie Tratt

Microservices - James Lewis, Martin Fowler

The Mythical Man-Month -Fred Brooks

Tidy Data -Hadley Wickham

Thomas Wiecki’s talks on machine learning

Venture: a higher-order probabilistic programming platform with programmable inference -Vikash

Characterizing people as non-linear, first-order components in software development -Alistair Cockburn

The Mature Optimization Handbook

The Log: What every software engineer should know about real-time data's unifying abstraction -Jay Kreps

Real-Time Frameworks That Are App-ifying The Web -Peter Baumgartner (blogpost)

Efficient Virtual Memory for Big Memory Servers -Arkaprava Basu et al.

Paper: Network Stack Specialization For Performance

Is It Time To Get Rid Of The Linux OS Model In The Cloud?

How to get over the fear of shipping (travis-ci blog)

Patterns For Large-Scale JavaScript Application Architecture -Addy Osmani

Learning Javascript Patterns -Addy Osmani

Writing concurrent code with lock-free algorithms

Optimizing Linux Memory Management for Low-latency / High-throughput Databases

ØMQ: The Theoretical Foundation

BlinkDB: Queries with Bounded Errors and Bounded Response Times on Very Large Data

Syntactic and Functional Variability of a Million Code Submissions in a Machine Learning MOOC -Jonathan Huang, Chris Piech, Andy Nguyen, and Leonidas Guibas

A Brief Study of Open Source Graph Databases

Managing Software Engineers -Philip Greenspun

NASA report on Toyota acceleration bug

The Future of Programming -Bret Victor


The Power of 10: Rules for Developing Safety Critical Code -Gerard J. Holzmann - wikipedia

A few Billion Lines of code Later: Using static Analysis to find Bugs in the Real World -Coverity team

QuakeCon 2012 keynote by John Carmack

Armin Ronacher’s talks

Systemantics -John Gall

Parsing Expression Grammars - slides

Typographical Extensions of Programming Languages -Paul W. Abrahams (1993)

Notation as a Tool of Thought -Ken Iverson

Modules Matter Most -Bob Harper

Mathematical Software and Me: A Very Personal Recollection -William Stein (sage)

Influence of cognitive models on programming language design

Pure pattern calculus -Barry Jay

Garbage Collection

Adoption-oriented langauge design -LEO A. MEYEROVICH

Unified debugging of distributed systems with Recon

Debugging Distributed Systems

Dreaming in code

David Barbour's natural programming languages article

Crash-only software: More than meets the eye -Valerie Henson

Availability in Globally Distributed Storage Systems -Various Googlers’s architecture

Cognitive Architectures:  A Way Forward for the Psychology of Programming

The Myth of the Genius Programmer

Programming and Scaling

Is Parallel Programming Hard, And, If So, What Can You Do About It? -Paul E. McKenney

Various LockLess articles -Stephen Fuerst


Nix: A purely functional package manager for Linux and OS X

LibBi: Bayesian state-space modelling on parallel computer hardware (code)

Hakaru: A probabilistic programming language using haskell & Maple

Nvim-R: R environment for Vim

Apache Parquet: A columnar storage format (java, cpp)

Bambi: BAyesian Model-Building Interface (BAMBI) in Python

Universal-ctags, Kythe, OpenGrok: Source code navigation tools 

HBC: Hierarchical Bayesian Compiler (2007) -Hal Daume (paper)

Libxsmm: Library for small matrix multiplications and convolutions. jit targets intel cpus (poster)

Prophet: Polyglot procedure for forecasting time series data. Supports R, Python (paper, site, licensing issue)

Keras: Deep Learning library for Theano and TensorFlow (docs)

Emcee: Python ensemble sampling toolkit for affine-invariant MCMC (docs)

Elbow: Flexible Bayesian inference using TensorFlow

Feather: Polyglot interface for the Apache Arrow in-memory column store, supporting Python, R, Javascript

NIMBLE: An R package for programming with BUGS models and compiling parts of R (paper)

python-afl: American fuzzy lop fork server and instrumentation for pure-Python code

jsCoq: A port of Coq to Javascript -- Run Coq in your Browser

cvc4: Satisfiability Modulo Theories (code, dev guide, api docs, internal docs)

nauty: Graph canonical labeling (Apache 2) (paper)

Libsvm: Polyglot SVM with source in C++/Java and bindings in Matlab/Python (paper, site)

Hypernom: Mapping VR Headset Orientation to S^3 -Vi Hart, Andrea Hawksley, Henry Segerman, Marc ten Bosch (paper)

Squishyball: command-line tool for comparing audio files (manpage)

Swift: compiler for BLOG probabilistic programming language (paper)

Daft: Render probabilistic graphical models with matplotlib

Watchman: A file watching service by Facebook (github)

Edward: A library for probabilistic modeling, inference, and criticism.

ShellCheck: a static analysis tool for shell scripts (github)

EmptyHeaded: A modern join optimizer (from Christopher Re’s lab)

Teaching C (2016) -John Regehr (blog post full of great pointers; discussion)

Theft: property-based testing in C (intro)

Tensorflow: Google’s dataflow language for tensor computations (whitepaper)

Haxl: Distributed dataflow library in Haskell by Facebook

QuantLib: the free/open-source library for quantitative finance (github)

Riak and Erlang/OTP (in AOSA) -Francesco Cesarini, Andy Gross, and Justin Sheehy

misc beautiful code...

DynASM: LuaJIT’s dynamic assembler a free vector graphics web app

Terra (paper, thesis): A low-level counterpart to Lua

sqlite, lua, luajit, beam, cpython: vms in c

sketch-n-sketch (paper, discuss, talk): programmatic + direct manipulation + svg

asm.js, wasm (design docs): assembly language for the web

Brotli (blogpost): higher compression than gzip

cgminer, farmhash-c, intel extensions, compress-then-hash, smhasher: fast hashing

libmill, lthread, libconcurrent, libtask, etc.: C coroutine libraries

Shed Skin, Nuitka: Python compilers

Whetstone, Dhrystone, Pystone, plb, Benchmarks Game: PL benchmarks

caramel: a modern syntax for the λ-calculus

upb: a jit parser for protobuf, json, and more

seL4: a microkernel for fully verified systems via separation kernel

Contributor Covenant: a code of conduct for open source projects

Redux: a predictable state container for JavaScript apps

Cereal: a C++11 serialization library

Benchmark problems of the Reactive Synthesis Competition (paper)

CoVim, Floobits: Collaborative coding in vim, or any editor

ast: Python library to access python abstract syntax trees

Sourcegraph: an intelligent, hackable code host for teams (readme, hn, github, blogpost)

srclib: a polyglot code analysis library, built for hackability

Quipper: an embedded, scalable functional programming language for quantum computing

Hypothesis: a Quickcheck-style testing library for Python

Dato SFrame, including SGraph for large-scale graph computation

nosebook: nosetests for iPython notebooks

FlameGraph (blogpost about cpu profiling)

github pages


docker: for osx dev - on travis - hub - on EC2

boot2docker: docker on OS X

cloudpickle: piclouds’s function serialization library (extracted by pyspark)

AWS Lambda

argcomplete: bash autocompletion for python argparse

Google Cloud Dataflow

toolz, multipledispatch: python utility libraries

LogicJS: logic programming for javascript

logpy, pyDatalog, pyrolog, pythlog, pylog: logic programming in python

xdelta, rsync, VDIFF standard, Andrew Tridgell’s 1999 PhD thesis

oprofile and perf: linux profiling tools

Sketch and CEGIS: a system for program synthesis - paper

Z3: an efficient theorem prover by Microsoft Research (code)

Hypothesis: Quickcheck style testing library for Python (github)

Symas Lightning Memory-Mapped Database (LMDB)

Hustle: A column oriented, embarrassingly distributed relational event database.

FastBit: An Efficient Compressed Bitmap Index Technology

EWAHBoolArray: A compressed bitmap class in C++

STAPL: Standard Template Adaptive Parallel Library - paper

Skim: a mac pdf reader

lz4: Extremely Fast Compression algorithm

Dafny: a language and program verifier for functional correctness

Google Cloud Dataflow - Java SDK - Docs

JScert: certified javascript (github)

dpdgraph: dependency graphs for Coq

slack: communication for teams

Pluto: a first concurrent web server in Gallina/Coq (github)

Pandoc: a universal document converter

LtacProf: Profiling for Ltac -Tobias Tebbi

lectures on CIC and Coq -Maria Jo˜ao Frade

coq: lambda-calculus - mindless-coding - HoTT - CompCert - Princeton VST - QuickChick - Ssreflect - LibTactics

Isabelle Primer for Mathematicians -B. Grechuk

Latent Tree Model softwares of Nevin L Zhang

pebl: Learn Bayes Net structure in Python (paper)

Tabular: a schema-driven learner from MS research (paper)

Stratego: a language and toolset for program transformation

paths.js: yet another svg path generator

quipper: a quantum programming language

jstat: javascript statistical library

zeromq security (tls)

seneca: a microservices framework for node.js

hampsterdb’s testing infrastructure (lauded in highscalability)

Google javascript style guide

coverity addon for travis-ci - cpplint - astyle - Google C++ style guide (code quality)

Codea: a touch-based code editor app for iPad

Browserify, on github

heroku intro to npm - nodejitsu intro - nodejitsu lessons (npm best practices)

protocol-buffers for Node.js

Yodlee Financial Platform

STXXL 1.4.0 and Beyond -Timo Bingmann

Erlang on Xen - multi-machine, hypervisor direct access (from Eric Lee)

LuaJIT - developed for a private equity firm in NY, JIT-compiler is modular and can run other languages written to its interface - compiler optimizations (from Eric Lee)

Yeppp! - yepBuiltin_Log_32f_32f (BSD-licensed library of fast vectorized math)

lightning db

lever stack: derby.js - racer.js - share.js - peer.js -

uglifyjs parser - esprima on github (javascript parsers in javascript) - improv - stunt (a user-modifyable web stack)

github repo hooks api - on github (a realtime microframework for node.js = express +

ACE - api - on github (a browser-based editor)

redis persistence

noBackend - unhosted - stackoverflow thread (lists of tools for client-heavy web apps)

packer - on github - packer→vagrant (create machine images for multiple platforms)

togetherjs - on github - blogpost (a non-persisting real-time collaboration javascript library)

transparent hugepages - in ubuntu (larger pages can reduce TLB wait by 5-50%)

libhugetlbfs - article - howto - bibliography (linkable support for huge pages) - zeromq in node.js

Chrome secure shell

intro to full-stack javascript

RxJS - on github (FRP library in javascript)

bacon.js - author blog - project log - in flowdock (FRP library in javascript)

collabode - on github (a real-time collaborative error-mediated IDE) - in flowdock - backbone+PubNub - sharejs

marionette.js (on github) (a convenience layer on top of backbone)

ACE editor - tedit Chrome app - hackify (on github)


django + ssl

mint - personal capital - check

Profile Guided Optimization (PGO): story - makefile example - stackoverflow

vagrant (a cross-platform vm manager supporting AWS, VirtualBox, etc)

OAuth2 tutorial - google tutorial - google APIs - rauth - flask plugin - oauth2lib - google+ sign in - simpleauth - requests - github - gist - graphgist - gist via jsonp another

Amazon kinesis, article (scalable message queues)

Review Board (via RBCommons or Bitnami) - Gerrit - Phabricator’s Differential - Crucible

Google+ OAuth in python

Trident (high level wrapper for Storm)

Naiad (scalable differential computation)

Twitter Summingbird (streaming mapreduce)

Tarsnap (source, purportedly beautiful) (easy backups)

Organizing a Backbone.js application using modules

server-sent events - bottle+WebSockets - real-time python

sharejs - livedb - ottypes - opencoweb

parallel s3 upload - alt - alt - alt - alt - boto - aws blog

Jasmine (a javascript testing framework)

AGDA programming language

backbone.js - annotated source - tutorials - good tutorial

d3 tutorials gallery - bokeh

Sirea -dmbarbour

kyoto-cabinet (a barebones performant key-value store in C++)

mrjob - video - emr class - blogpost - examples - github search

Javascript style - Grunt - QUint - js-test-driver - google-js-test

Code Bubbles - Absynte - Intentional Programming

EC2 scripting: StarCluster (github) - Boto - Spark

Vim power usage: powerline - ctrlp - nerd tree

C++11 noexcept, -Wnoexcept

How to run cmake unit tests in parallel?

sails.js - on github (a realtime MVC framework for node.js)

x0 = xzero - on github (HTTP web server and framework in C++11)

Jubatus - SAMOA (distributed online machine learning)

Kafka - Zookeeper - Storm - S4

Varnish & pagecache-centric programming

taskset - processor affinity - numactl - libnuma

Rust programming language - wikipedia - github - ltu

Substance.Chronicle (a git-inspired operational transformation framework for node.js)

Substance.Data - github (a graph data manipulation & persistence library, part of Substance)

moose - book (a platform for software and data analysis)

funcy - blogpost (ancestor of junify)

OMeta - OMeta/JS - pymeta (a general PEG pattern matching language)

JUnify (pattern matching in javascript)

cppcheck (wikipedia)

HTCondor - HTC at CERN - BOINC (src)

Amazon SWF - boto.swf.layer2 - example - example

What are the differences among the libhdf5-*-dev ubuntu packages?

enable TRIM on SSD in linux - on encrypted drive


Rethinking LDA: Why Priors Matter (2009) -Hanna M. Wallach David Mimno Andrew McCallum

Fast MCMC sampling for hidden markov models to determine copy number variations (2011) -Md Pavel Mahmud, Alexander Schliep

EM versus Markov chain Monte Carlo for Estimation of Hidden Markov Models: A Computational Perspective (2008) -Tobias Ryden (slides)

Bayesian Methods for Hidden Markov Models: Recursive Computing in the 21st Century (2002) -Steven L. Scott

Graphical Models: An Extension to Random Graphs, Trees, and Other Objects (2017) -Neil Hallonquist

Bayesian Nonparametric Modeling for Multivariate Ordinal Regression (2016) -Maria DeYoreo, Athanasios Kottas

The Zig-Zag Process and Super-Efficient Sampling for Bayesian Analysis of Big Data (2016) -Joris Bierkens, Paul Fearnhead, Gareth Roberts (talk)

Discontinuous Hamiltonian Monte Carlo for sampling discrete parameters (2017) -Akihiko Nishimura, David Dunson, and Jianfeng Lu

Towards Unifying Hamiltonian Monte Carlo and Slice Sampling (2016) -Yizhe Zhang, Xiangyu Wang, Changyou Chen, Ricardo Henao , Kai Fan, Lawrence Carin

Deep Bayesian Active Learning with Image Data (2016) -Yarin Gal, Riashat Islam, Zoubin Ghahramani (code)

Simplifying Probabilistic Programs Using Computer Algebra (2016) Jacques Carette, Chung-chieh Shan

Understanding predictive information criteria for Bayesian models (2013) -Andrew Gelman, Jessica Hwang, and Aki Vehtari

Composing inference algorithms as program transformations (2016) -Robert Zinkov, Chung-chieh Shan (talk)

PHOG: Probabilistic Model for Code (2016) -Pavol Bielik, Veselin Raychev,  Martin Vechev

Structured Generative Models of Natural Source Code (2014) Chris J. Maddison, Daniel Tarlow

Approximations of Markov Chains and Bayesian Inference (2016) James E. Johndrow, Jonathan C. Mattingly, Sayan Mukherjee, David Dunson

Deep Bayesian Active Learning with Image Data (2017) -Yarin Gal, Riashat Islam, Zoubin Ghahramani

Approximate Inference with Amortised MCMC (2017) -Yingzhen Li, Richard E. Turner, Qiang Liu

Deep Probabilistic Programming (2017) -Dustin Tran, Matthew D. Hoffman, Rif A. Saurous, Eugene Brevdo, Kevin Murphy, David M. Blei

Programming with models: writing statistical algorithms for general model structures with NIMBLE (2016) -Perry de Valpine, Daniel Turek, Christopher J. Paciorek, Clifford Anderson-Bergman, Duncan Temple Lang, Rastislav Bodik

Information Theory, Inference, and Learning Algorithms (2003) -David J.C. MacKay (textbook)

Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm (2016) Qiang Liu, Dilin Wang

Redescending M-estimator (wikipedia)

TerpreT: A Probabilistic Programming Language for Program Induction (2016) -Alexander L. Gaunt, Marc Brockschmidt, Rishabh Singh, Nate Kushman, Pushmeet Kohli, Jonathan Taylor, Daniel Tarlow

Graph limits and exchangeable random graphs (2007) -PERSI DIACONIS, SVANTE JANSON

Posterior Dispersion Indices (2016) -Alp Kucukelbir, David M. Blei

The Emerging Field of Signal Processing on Graphs (2013) -David I Shuman, Sunil K. Narang, Pascal Frossard, Antonio Ortega, Pierre Vandergheynst

Data association in multi-target tracking: a solution using a layered Boltzmann machine (1991) Ronald A. Iltis, PY Ting

Estimating Sparse Precision Matrices from Data with Missing Values (2012) - Mladen Kolar, Eric P. Xing

Gradient Estimation Using Stochastic Computation Graphs (2015) -John Schulman, Nicolas Heess, Theophane Weber, Pieter Abbeel

Stochastic Backpropagation and Approximate Inference in Deep Generative Models (2014) -Danilo Jimenez Rezende, Shakir Mohamed, Daan Wierstra

Ensuring Rapid Mixing and Low Bias for Asynchronous Gibbs Sampling (2016) -Christopher De Sa, Kunle Olukotun, and Christopher R´e

Optimal Design

Random Features for Large-Scale Kernel Machines (2007) -Ali Rahimi, Ben Recht

A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion (2012) -James Martin, Lucas C. Wilcox, Carsten Burstedde, Omar Ghattas

Gaussian Markov random fields: theory and applications (2005) -H Rue, L Held

Patterns of Scalable Bayesian Inference (2016) -Elaine Angelino, Matthew James Johnson, Ryan P. Adams

A hierarchical ensemble method for DAG-structured taxonomies (2015) -Peter N. Robinson, Marco Frasca, Sebastian K¨ohler, Marco Notaro, Matteo Re, Giorgio Valentini

A Monte-Carlo AIXI Approximation (2011) -Joel Veness, Kee Siong Ng, Marcus Hutter, William Uther, David Silver

Large Scale Distributed Deep Networks (2012) -Jeffrey Dean, Greg S. Corrado, Rajat Monga, Kai Chen, Matthieu Devin, Quoc V. Le, Mark Z. Mao, Marc’Aurelio Ranzato, Andrew Senior, Paul Tucker, Ke Yang, Andrew Y. Ng

Thompson sampling: an exploration-exploitation heuristic for the multi-armed bandit problem

Learning structured embeddings:

Ranking Measures and Loss Functions in Learning to Rank (2009) -Wei Chen, Tie-Yan Liu, Yanyan Lan, Zhiming Ma, Hang Li

Benefits of Bias: Towards Better Characterization of Network Sampling (2011) -Arun S. Maiya, Tanya Y. Berger-Wolf

Graph-Based User Behavior Modeling: From Prediction to Fraud Detection (ACM KDD 2015 Tutorial) -Alex Beutel, Leman Akoglu, Christos Faloutsos

Community Detection in Social Networks: An In-depth Benchmarking Study with a Procedure-Oriented Framework (2009) -Meng Wang, Chaokun Wang, Jeffrey Xu Yu, Jun Zhang

On the relationship between Gaussian stochastic blockmodels and label propagation algorithms (2015) -Junhao Zhang, Tongfei Chen, Junfeng Hu

Distributed Stochastic Variance Reduced Gradient Methods (2015) -Jason Lee, Tengyu Ma, Qihang Lin

Metric Learning with Multiple Kernels (2011) -Jun Wang, Huyen Do, Adam Woznica, Alexandros Kalousis

Anti-differentiating approximation algorithms: A case study with min-cuts, spectral, and flow (2014) -David F. Gleich, Michael W. Mahoney

Using Local Spectral Methods to Robustify Graph-Based Learning Algorithms (2015) -David F. Gleich, Michael W. Mahoney

Supervised Random Walks: Predicting and Recommending Links in Social Networks (2011) -Lars Backstrom, Jure Leskovec

Semi-Supervised Learning with Measure Propagation (2011) -Amarnag Subramanya, Jeff Bilmes

Visualizing Data using t-SNE (2008) -Laurens van der Maaten, Geoffrey Hinton

Markov Chain Monte Carlo and Variational Inference: Bridging the Gap (2014) -Tim Salimans, Diederik P. Kingma, Max Welling

Additive Co-Clustering to Approximate Matrices Succinctly -Alex Beutel, Amr Ahmed, Alexander J. Smola

The Bayesian Echo Chamber: Modeling Social Influence via Linguistic Accommodation (2014) -Fangjian Guo, Charles Blundell, Hanna Wallach, Katherine Heller

Streaming Variational Inference for Bayesian Nonparametric Mixture Models (2015) -Alex Tank Nicholas J. Foti Emily B. Fox

Accurate Prediction of Phase Transitions in Compressed Sensing via a Connection to Minimax Denoising (2011) -David Donoho, Iain Johnstone, Andrea Montanari

Exploiting compositionality to explore a large space of model structures -Roger B. Grosse, Ruslan Salakhutdinov, William T. Freeman, Joshua B. Tenenbaum

Learning Bayesian Networks: The Combination of Knowledge and Statistical Data -David Heckerman, Dan Geiger, David M. Chickering

NIPS Workshops in Probabilistic Programming: 2008 - 2012

Stochastic Gradient Riemannian Langevin Dynamics on the Probability Simplex -Sam Patterson, Yee Whye Teh

The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo -Matt Hoffman, Andrew Gelman

Classifier Technology and the Illusion of Progress -David J. Hand

Representation Learning: A Review and New Perspectives -Yoshua Bengio, Aaron Courville, Pascal Vincent (recommended by Beau Cronin)

Misc papers on: dirichlet diffusion processes, normalized generalized gamma processes


Hierarchical Dirichlet Processes -Teh, Jordan, Beal, Blei

Hierarchical Topic Models and the Nested Chinese Restaurant Process -Blei, Griffiths, Jordan, Tennenbaum

Latent Tree Models (misc papers)

A Spectral Algorithm for Latent Tree Graphical Models -Ankur P. Parikh, Le Song, Eric P. Xing

A Survey on Latent Tree Models and Applications -Rapha¨el Mourad, Christine Sinoquet, Nevin L. Zhang, Philippe Leray

Latent Tree Models and Approximate Inference in Bayesian Networks -Yi Wang, Nevin L. Zhang, Tao Chen

Thermodynamic Monte Carlo -Michael Betancourt (discussed by Andrew Gelman)

Getting it Right: Joint Distribution Tests of Posterior Simulators -John Geweke

Speeding Up MCMC by Efficient Data Subsampling -Matias Quiroz, Mattias Villani, Robert Kohn

AISTATS14 papers

Stochastic Collapsed Variational Bayesian Inference for Latent Dirichlet Allocation -James Foulds, Levi Boyles, Christopher Dubois, Padhraic Smyth, Max Welling

A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation -Yee Whye Teh, David Newman, Max Welling

Sample Selection Bias Correction Theory -Corinna Cortes, Mehryar Mohri, Michael Riley, Afshin Rostamizadeh

Exploiting the Statistics of Learning and Inference -Max Welling

Reinforcement Learning: An Introduction -Sutton & Barto (textbook)

Student-t Processes as Alternatives to Gaussian Processes -Amar Shah, Andrew Gordon Wilson, Zoubin Ghahramani

Efficient Reinforcement Learning using Gaussian Processes -Marc Peter Deisenroth

Gaussian process modelling of multiple short time series -Hande Topa, Antti Honkela

Clustering Short Time Series Gene Expression Data -Jason Ernst, Gerard J. Nau, Ziv Bar-Joseph (2005)

Gaussian Processes for Machine Learning -Carl Edward Rasmussen, Christopher K. I. Williams

A Bayesian characterization of relative entropy -John Baez, Tobias Fritz (blogpost)

A tutorial on hidden markov models and selected applications in speech recognition -Lawrence Rabiner

Bayesian Nonparametric Hidden Markov Models -Jurgen Van Gael (PhD thesis)

Learning Finite State Machines -Colin de la Higuera

Strong consistency of nonparametric Bayes density estimation on compact metric spaces -Abhishek Bhattacharya, David Dunson

Posterior Consistency of Dirichlet Location-scale Mixture of Normals in Density Estimation and Regression -Surya T. Tokdar

Posterior consistency of Dirichlet mixtures in density estimation -S. Ghosal, J. K. Ghosh, R. V. Ramamoorthi

The Dirichlet process, related priors and posterior asymptotics -Subhashis Ghosal (slides)

Adaptive Convergence Rates of a Dirichlet Process Mixture of Multivariate Normals -S. Tokdar

Convergence rates of posterior distributions -S. Ghosal, J. K. Ghosh, A. Van Der Vaart

Posterior convergence rates of Dirichlet mixtures at smooth densities -Ghosal, van der Vaart

An Alternative Prior Process for Nonparametric Bayesian Clustering -Hanna Wallach et al (yuck, nonexchangeable)

Statistics Done Wrong: The woefully complete guide -Alex Reinhart

Parallel EM learning for symbolic-statistical models -Y Izumi, Y Kameya, T Sato

Model Selection and the Principle of Minimum Description Length -Mark H. Hansen and Bin Yu

Grouping Priors and the Bayesian Elastic Net -Luke Bornn, Raphael Gottardo, Arnaud Doucet

Sequential monte carlo samplers -P Del Moral, A Doucet, A Jasra

Bayesian analysis of massive datasets via particle filters -Greg Ridgeway, David Madigan (2002)

A Sequential Particle Filter Method for Static Models -Nicolas Chopin (2002)

Augur: a Modeling Language for Data-Parallel Probabilistic Inference -J-B Tristan, et al

Summary Statistics for Partitionings and Feature Allocations -Fidaner, Cemgil

Hyperbolic Geometric Diffusion (misc google hits)

The Infinite PCFG using Hierarchical Dirichlet Processes -Percy Liang, Slav Petrov, Michael I. Jordan, Dan Klein

Probabilistic Grammars and Hierarchical Dirichlet Processes -Percy Liang, Michael I. Jordan, Dan Klein

The Oxford Handbook of Applied Bayesian Analysis

Monte Carlo Methods in Statistical Mechanics: Foundations and New Algorithms -Alan D Sokal

Towards common-sense reasoning via conditional simulation: legacies of Turing in Artificial Intelligence -Freer, Roy, Tennenbaum

AISTATS 2013 Proceedings

Harold Jeffreys’s Theory of Probability Revisited -C. Robert, N. Chopin, J. Rousseau

Rolling Markov Chain Monte Carlo - A System for Sequential Updating

Nonstandard Interpretations of Probabilistic Programs for Efficient Inference

Learning with Hierarchical-Deep Models

Annealing and Tempering for Sampling and Counting -Nayantara Bhatnagar (thesis)

The Entropy Concept for Non-Equilibrium States (rec. by J. Glidden)

Tropical Geometry of Statistical Models

Geometry of the Restricted Boltzmann Machine

The Indian Buffet Process: An Introduction and Review

Machine Learning for Large Scale Recommender Systems (ICML tutorial)

Posterior consistency for the number of components in a finite mixture

A Bayesian Approach to Concept Drift -Stephen H. Bach Marcus A. Maloof

A Coupled Indian Buffet Process Model for Collaborative Filtering -Sotirios P. Chatzis

Nonparametric Latent Feature Models for Link Prediction -Miller, Griffiths, Jordan

Simulating Normalizing Constants: From Importance Sampling to Bridge Sampling to Path Sampling -Andrew Gelman and Xiao-Li Meng

Streaming Variational Bayes -Tamara Broderick, ..., Michael I. Jordan

Dropout Training as Adaptive Regularization -Stefan Wager, Sida Wang, Percy Liang

Misc papers on dropout training

Optimal allocation of replicas in parallel tempering simulations

Finite-time thermodynamics and simulated annealing -Bjarne Andresen

A Note on the Finite Time Behaviour of Simulated Annealing -A. Nolte , R. Schrader

Cooling schedules for optimal annealing

Exact Sampling (David Wilson’s bibliography)

Exact and Approximate Sampling by Systematic Stochastic Search

On the acceptance probability of replica-exchange Monte Carlo trials and Comment on ...

Replica-exchange molecular dynamics method for protein folding

On the combination of logical and probabilistic models for information analysis -Jingsong Wang et al

A probabilistic solution to the MEG inverse problem via MCMC methods: the reversible jump and parallel tempering algorithms

History of Fisher Information

On the History of Maximum Likelihood in Relation to Inverse Probability and Least Squares

Machine learning that matters

Various book chapters by Pedro Domingos (probabilistic theorem proving)

CONQUEST: A Coarse-Grained Algorithm for Constructing Summaries of Distributed Discrete Datasets -Jie Chi, Mehmet Koyut¨urk, and Ananth Grama

A Survey of Grammatical Inference in Software Engineering (2014) -Andrew Stevenson, James R. Cordy

Low Assumptions, High Dimensions (2011) -Larry Wasserman

Testing MCMC code (2014) -Roger B. Grosse, David K. Duvenaud

Perturb-and-MAP Random Fields: Using Discrete Optimization to Learn and Sample from Energy Models (2011) -George Papandreou, Alan L. Yuille

A* Sampling (2014) -Chris J. Maddison, Daniel Tarlow, Tom Minka

Mapping Energy Landscapes of Non-Convex Learning Problems -Maria Pavlovskaia, Kewei Tu, Song-Chun Zhu

Accelerating Inference: towards a full Language, Compiler and Hardware stack -Shawn Hershey, Jeff Bernstein, Bill Bradley, Andrew Schweitzer, Noah Stein, Theo Weber, Ben Vigoda

ProbLog2: From Probabilistic Programming to Statistical Relational Learning -Joris Renkens, Dimitar Shterionov, Guy Van den Broeck, Jonas Vlasselaer, Daan Fierens, Wannes Meert, Gerda Janssens, Luc De Raedt

Constraints for Probabilistic Logic Programming -Daan Fierens, Guy Van den Broeck, Maurice Bruynooghe, Luc De Raedt

Firefly Monte Carlo: Exact MCMC with Subsets of Data -Dougal Maclaurin, Ryan P. Adams

Improving Prediction from Dirichlet Process Mixtures via Enrichment -Sara Wade et al.

Automated Variational Inference in Probabilistic Programming -David Wingate, Theo Weber

Accelerating MCMC via Parallel Predictive Prefetching -Elaine Angelino et al.

A click prediction: a view from trenches -H. B. McMahan et al

Gaussian Processes for Timeseries Modelling -S. Roberts, et al (gentle introduction)

Diffusion limits of the random walk Metropolis algorithm in high dimensions -Jonathan Mattingly, Natesh Pillai, Andrew Stuart

Understanding Boltzmann Machine and Deep Learning via A Confident Information First Principle
Quantum Annealing for Dirichlet Process Mixture Models with Applications to Network Clustering

Adaptive Bayesian density estimation using Pitman-Yor or normalized inverse-Gaussian process kernel mixtures -Catia Scricciolo

The Equivalence of Sampling and Searching (rec. by J. Glidden)

Collapsed Variational Inference for HDP -Teh, Kurihara, Welling

Variational MCMC -N. De Freitas , P. Højen-Sørensen , M. Jordan , S. Russell

Bayes, Jeffreys, Prior Distributions and the Philosophy of Statistics -Andrew Gelman

The Tradeoffs of Large Scale Learning -Leon Bottou, Olivier Bousquet

Inconsistency of Pitman-Yor process mixtures for the number of components

Pseudorandomness -O. Goldreich (an AMS Notices survey)

Splitting and Merging Components of a Nonconjugate Dirichlet Process Mixture Model -Sonia Jain, Radford Neal

Austerity in MCMC Land: Cutting the Metropolis-Hastings Budget -Korattikara, Chen, Welling

Replica-exchange Monte Carlo scheme for bayesian data analysis -Habeck, Nilges, Rieping

Parallel tempering: Theory, applications, and new perspectives

Construction of Nonparametric Bayesian Models from Parametric Bayes Equations

Spectral Methods for Latent Models and Hsu’s slides pointed to therein

A Spectral Algorithm for Learning Hidden Markov Models

Spectral Learning of Latent-Variable PCFGs

Parallel MCMC with generalized elliptical slice sampling

Statistical Physics of Fracture, Friction and Earthquake

Mathematical Logic

CVC4 (2011) -Clark Barrett, Christopher L. Conway, Morgan Deters, Liana Hadarean, Dejan Jovanovic, Tim King, Andrew Reynolds, Cesare Tinelli

Architecting Solvers for SAT Modulo Theories: Nelson-Oppen with DPLL (2007) -Sava Krsti´c, Amit Goel (slides)

A Survey of Satisfiability Modulo Theory (2016) -David Monniaux

A Tutorial on Satisfiability Modulo Theories (2007) -Leonardo de Moura, Bruno Dutertre, and Natarajan Shankar

The SMT-LIB Standard Version 2.5 (2015) -Clark Barrett, Pascal Fontaine, Cesare Tinelli

Categorical homotopy theory (2014) -Emily Riehl

Linear beta-reduction (2017) -Stefano Guerrini

Random generation of closed simply-typed λ-terms: a synergy between logic programming and Boltzmann samplers (2016) -Maciej Bendkowski, Katarzyna Grygiel, Paul Tarau

Mixed powerdomains for probability and nondeterminsm (2016) Klaus Keimel, Gordon Plotkin

A Survey of Computability Logic (2016) -Giorgi Japaridze

Formal Reasoning About Programs (ebook) (2016) -Adam Chlipala

Smart matching (2010) -Andrea Asperti, Enrico Tassi

Embeddings as a Higher-Order Representation of Annotations for Rippling (2005) -L. A. Dennis, I. Green and A. Smaill

Combining Superposition and Induction: A Practical Realization (2014) -Abdelkader Kersani, Nicolas Peltier

Verifying Higher-Order Functional Programs with Pattern-Matching Algebraic Data Types (2011) C.-H. Luke Ong, Steven J. Ramsay

SMT Solving for Functional Programming over Infinite Structures (2016) -Bartek Klin, Michał Szynwelski

The C standard formalized in Coq (2015) -Robbert Jan Krebbers

The Gradualizer: a methodology and algorithm for generating gradual type systems (2016) -Matteo Cimini, Jeremy Siek

Is Sound Gradual Typing Dead? (2016) Asumu Takikawa, Daniel Feltey, Ben Greenman, Max S. New, Jan Vitek, Matthias Felleisen (discussion)

Abstracting Gradual Typing (2016) -Ronald Garcia, Alison M. Clark, Éric Tanter

Observational Equality, Now! (2007) Thorsten Altenkirch, Conor McBride, Wouter Swierstra

Towards Observational Type Theory (2006) -Thorsten Altenkirch, Conor McBride

Conflict-Driven Clause Learning SAT Solvers (2008) -Joao Marques-Silva, Ines Lynce and Sharad Malik

Quipper: A Scalable Quantum Programming Language (2013) -Alexander S. Green, Peter LeFanu Lumsdaine, Neil J. Ross, Peter Selinger, Benoît Valiron

An Introduction to Quantum Programming in Quipper (2013) -Alexander S. Green, Peter LeFanu Lumsdaine, Neil J. Ross, Peter Selinger, Benoît Valiron

Models of Quantum Algorithms in Sets and Relations (2015) -William Zeng

Lattice-based data structures for deterministic parallel and distributed programming (2015) -Lindsey Kuper (slides, video)

Abstract Satisfaction (2014) -Vijay D’Silva, Leopold Haller, Daniel Kroening

Abstract Conflict Driven Learning (slides) (2013) -Vijay D’Silva, Leopold Haller, Daniel Kroening

Second-Order Functions and Theorems in ACL2 (2015) -Alessandro Coglio

Pop-Refinement (2014) -Alessandro Coglio

Lambert Meertens’ papers on reasoning in lattices 

Semi-decidability of may, must and probabilistic testing in a higher-type setting (2009) -Mart´ın Escard´o

A Unifying Approach to Recursive and Co-recursive Definitions -Pietro Di Gianantonio and Marino Miculan

Combining de Bruijn Indices and Higher-Order Abstract Syntax in Coq -Venanzio Capretta, Amy P. Felty

How to Write a 21st Century Proof -Leslie Lamport

Uncertainty Modelling and Conditioning with Convex Imprecise Previsions -Renato Pelessoni, Paolo Vicig

A survey of the theory of coherent lower previsions -Enrique Miranda

Full Abstraction for Non-Deterministic and Probabilistic Extensions of PCF I: the Angelic Cases -Jean Goubault-Larrecq (slides)

Observational Equality, Now! -Thorsten Altenkirch Conor McBride Wouter Swierstra

In a Search for a Structure, Part 1: On Entropy -Misha Gromov

A Small Scale Reflection Extension for the Coq system (SSReflect) -Georges Gonthier, Assia Mahboubi, Enrico Tassi

A Gentle Introduction to Type Classes and Relations in Coq -Pierre Castéran

Software Foundations -Benjamin C. Pierce, Chris Casinghino, Marco Gaboardi, Michael Greenberg, Cătălin Hriţcu, Vilhelm Sjöberg, Brent Yorgey

CoLoR: a Coq library on well-founded rewrite relations and its application to the automated verification of termination certificates -Frédéric Blanqui, Adam Koprowski (code)

Certified Programming with Dependent Types -Adam Chlipala (coq tutorial)

Interview with J. Barkley Rosser and Stephen C. Kleene

misc: The quantum-to-classical transition and decoherence -Maximilian Schlosshauer

Semantic Techniques in Quantum Computation:

2012 Turing Lectures at Princeton:

Univalent Foundations: New Foundations of Mathematics (video lecture) -Vladimir Voevodsky

On Coinductive Equivalences for Higher-Order Probabilistic Functional Programs -Ugo Dal Lago, Davide Sangiorgi, Michele Alberti

Efficient Program Synthesis Using Constraint Satisfaction in Inductive Logic Programming -John Ahlgren, Shiu Yin Yuen

Probabilistic Computation Tree Logic (PCTL): lecture

On-the-fly Fast Mean-Field Model-Checking: Extended Version -D Latella, M Loreti, M Massink

Session Types

Ordered Models of the Lambda Calculus -Antonino Salibra, Alberto Carraro
Lemma Mining over HOL Light -Cezary Kaliszyk, Josef Urban

Learning from multiple proofs: First experiments -Daniel Kuehlwein, Josef Urban

Daniel Kuehlwein’s work (Automated Theorem Proving, Machine Learning, Proof Verification)

Cezary Kaliszyk’s work

Graphic lambda calculus -Marius Buliga

Functorial Semantics of Algebraic Theories -Lawvere (PhD thesis)

Predicativity - Predicative foundations of arithmetic - A Survey of Predicativity

Lambda Calculus with Types -Barendregt, Dekkers, Statman

Tropical Fourier-Motzkin elimination, with an application to real-time verification

Tutorial on Universal Algebra (slides) -Peter Jipsen

The Universal Algebra of First Order Logic -Noel Vaillant

Universal Algebra -Jaroslav Jeˇzek

A Course in Universal Algebra -Stanley Burris, H. P. Sankappanavar

Homotopy Type Theory - coq code - agda code - pdf

Brief introduction to unprovability (covers Paris-Harrington thm & Brouwer’s fan theorem)

Brouwer’s Fan Theorem as an axiom and as a contrast to Kleene’s Alternative

TODO find that automated conjecturing thesis-turned-monograph from Berkeley library

Machine Learning of Coq Proof Guidance: First Experiments -Cezary Kaliszyk, Lionel Mamane, Josef Urban

Type classes for mathematics in type theory -B Spitters, E Van der Weegen

Experience Implementing a Performant Category-Theory Library in Coq -Jason Gross, Adam Chlipala, David I. Spivak

A Coq proof that Univalence axiom implies Functional Extensionality -A. Bauer and P. Lumsdaine (code)

Measure Transformer Semantics for Bayesian Machine Learning -Johannes Borgström, Andrew D Gordon, Michael Greenberg, James Margetson, Jurgen Van Gael

Without Loss of Generality -John Harrison

The Lambda Calculus is Algebraic -Peter Selinger, Benoˆıt Valiron

A Notion of a Computational Step for Partial Combinatory Algebras -Nathanael Ackerman, Cameron Freer

MizAR 40 for Mizar 40 -Cezary Kaliszyk, Josef Urban (scaling an automated reasoning engine)

Just do it: Simple monadic equational reasoning (discusses the RAND+JOIN monad)

Intensional Logic (sanford encyclopedia)

Canonicity for 2-Dimensional Type Theory -Daniel R. Licata, Robert Harper

Second order arithmetic (wikipedia)

Probabilistic theorem proving -Gogate V, Domingos P

Unifying logical and statistical AI -Pedro Domingos, et al.

Audio, Sound, Music

Wavenet: a generative model for raw audio (2016) -Aaron van den Oord, et a.

A Generative Theory of Tonal Music -Fred Lerdahl

Harmonic Experience: Tonal Harmony from Its Natural Origins to Its Modern Expression -Bill Mathieu


Parsing: The Solved Problem That Isn't - LTU

The “Physics” of Notations: Towards a Scientific Basis for Constructing Visual Notations in Software Engineering -Daniel L. Moody - discussion

The Semiotics of Programming -Kumiko Tanaka-Ishii

Mathematical Foundations for a Compositional Distributional Model of Meaning - citation

Montague Grammar


Map of a Nation: A Biography Of The Ordnance Survey

The new nature of maps: essays in the history of cartography

The Mapmakers

The story of maps

Elements of cartography

Mercator the Man Who Mapped the Planet

History of cartography -R. A. Skelton

The history of cartography -J. B. Harley (ed.), David Woodward (ed.)

The map that changed the world

Art, Artists - demoscene community

2014 Urban Data Canvas SF - 2013 Zurich | SF | Geneva

Casey Reas

Shane Hope

Richard Serra

Ursula von Rydingsvard

Web Design

Hack Design, meetup (see source)

Parallax scrolling - parallax.js - stellar.js

Poets, Poetry

R. Alcona To J. Brenzaida (1845) -Emily Jane Brontë

Alli Warren

Anne Sexton

Philip Larkin

Elizabeth Bishop


The Joy of Coffee - Corby Kummer (food writer for the atlantic)

linux on dell xps 11 9p33 - dell xps 12-9q33 bug report

Stephen Wright (comedian)

Antibodies -Charles Stross

The problem of the universe and its solution -Doug Hofsteader

An agent-based epidemiological model of incarceration -K.Lum, S.Swarup, S.Eubank, J.Hawdon

iCoach New York: how to coach readings

Der Zauberberg (The Magic Mountain) -Thomas Mann

Polaris Project blog

The Golden Bowl -Henry James

De patientia -Tertullian

Menschliches, Allzumenschliches: Ein Buch für freie Geister -Nietzsche

Mathematics Under the Microscope -Alexandre V. Borovik

Mathematics Under the Microscope -Alexandre V. Borovik (addenda)

Brief an der Vater -Franz Kafka

The Intervalgram: An Audio Feature for Large-scale Melody Recognition -Walters, Ross, Lyon

Autobiography of Jack Welch of GE

Night Thoughts -Edward Young (particularly the chapter on lost friends)

about TRIZ


Statistical mechanics of static and low-velocity kinetic friction

The Echo Maker (2006) -Richard Powers

Division by Zero -Ted Chiang (sci fi)

Childhood’s End -Arthur C. Clarke

Space-form and the acousmatic image -Denis Smalley

Grapes of Wrath -John Steinbeck

East of Eden - John Steinbeck

Food Combining

The Beast in the Jungle -Henry James

This is water -David Foster Wallace

Christopher Strachey - The Bloomsbury Group

The story of your life -Ted Chiang (sci fi)

Semiotics, Structuralism