David MacKay

Environment and Energy 
Information Theory 
·Textbook « 
·Gallager codes & MN codes 
·Theory of Sparse Graph codes 
·Regular Gallager codes 
·Irregular Gallager codes 
·Turbo codes  
·Insertions and deletions 
·Quantum Codes 
·Cryptanalysis and Coding 
·Discussion documents 
·More Message-Passing 
Probabilistic Data Modelling 
·PhD thesis 
·Bayes for neural networks 
·ICA & Latent Variable Models 
·Bayes FAQ 
·Bayesian computations 
·Monte Carlo methods 
·Variational methods 
·Gaussian processes 
·Language, Proteins, Density nets 
·Images, Radar, Neuroscience 
·Materials science 
·Decision theory, Fair Elections 
Human-computer Interfaces 
Computational Neuroscience 
Evolution and Molecular Biology  
Miscellaneous work 
Software and Files 
Any Problems? 

Search :


There is a website devoted to this book

Information Theory, Inference, and Learning Algorithms

(Hardback, 640 pages, Published September 2003)

Order your copy

Price: £35.00 / $60.00 from |CUP UK/USA| |amazon.co.uk/.com/.ca/.co.jp| | Barnes & Noble USA | booksprice. | fetchbook.info | allbookstores | biggerbooks | blackwells | directtextbook | kalahari.net (South Africa) | Special Paperback edition for South Asia.|

Download the book too

You can browse and search the book on Google books.

You may download The book in one file (640 pages):

U.K. english Canada canada South Africa south africa
PDF (A4) pdf (9M) (fourth printing, March 2005) pdf pdf
Postscript (A4) postscript (fourth printing, March 2005) (5M) postscript postscript
EPUB - experimental format epub file (fourth printing) (1.4M) ( ebook-convert book.pdf book.epub --isbn 9780521642989 --authors "David J C MacKay" --book-producer "David J C MacKay" --comments "Information theory, inference, and learning algorithms - experimental epub version 31.8.2014" --language "English" --pubdate "2003" --title "Information theory, inference, and learning algorithms" --cover ~/pub/itila/images/Sept2003Cover.jpg ) experimental epub file was created in UK 31 Aug 2014
DJVU djvu file (6M) (2nd printing) djvu file djvu file
(djvu information | Download djView)
Just the words (latex) [provided for convenient searching] (2.4M) (latex) (latex)
Just the figures NEW All in one file (postscript) [provided for use of teachers] (2M)
(pdf) (5M) (ps.gz) (pdf)
In individual eps files
Individual chapters postscript and pdf available from this page mirror mirror


  • Version 6.0 was released Thu 26/6/03; the book is finished. You are welcome to view the book on-screen. Version 6.0 was used for the first printing, published by C.U.P. September 2003.
  • Version 6.6 was released Mon 22/12/03; it will be used for the second printing, to be released January 2004. In this second printing, a small number of typographical errors were corrected, and the design of the book was altered slightly. Page-numbering generally remains unchanged, except in chapters 1, 6, and 28, where a few paragraphs, figures, and equations have moved around. All equation, section, and exercise numbers are unchanged.
  • Version 7.0 is the third printing (November 2004). Its only differences from the 2nd printing are a number of corrections, and the renaming of the chapter `Correlated Random Variables' to `Dependent Random Variables'.

Copyright issues: The book is copyright (c) Cambridge University Press. It has been available in bookstores since September 2003. The cover price in 2003 was 30 pounds (UK) and $50 (USA); in 2006, 35 pounds and $60 (USA).

Now the book is published, these files will remain viewable on this website. The same copyright rules will apply to the online copy of the book as apply to normal books. [e.g., copying the whole book onto paper is not permitted.]

Draft 1.1.1 - March 14 1997.
Draft 1.2.1 - April 4 1997.
Draft 1.2.3 - April 9 1997.
Draft 1.2.4 - April 10 1997. Margins altered so as to print better on Northamerican paper
Draft 1.3.0 - December 23 1997.
Draft 1.9.0 - Feb 1 1999.
Draft 2.0.0 - Jan 6 2000. New page layout.
Draft 2.2.0 - Dec 23 2000. Fresh draft.
Draft 3.1415 - Jan 12 2003. Nearly finished.
Draft 4.0 - April 15 2003. Chapter sequence finalized.
Draft 4.1 - April 18 2003. Adding new frontmatter (Preface etc)to book. Corrected printing of letter version.
Version 6.0 - Thu 26 June 2003. Final version.
Version 6.6 - Mon 22 December 2003. Second printing.

  • Here is my method for converting to two-up under linux:
    pstops '4:0L@.67(20cm,1cm)+1L@.67(20cm,15cm),3R@.67(1cm,15.25cm)\
    +2R@.67(1cm,29.25cm)' $*.ps $*.dps 

The Inference Group is supported by the Gatsby Foundation
and by a partnership award from IBM Zurich Research Laboratory
David J.C. MacKay
Site last modified Wed Nov 12 17:38:44 GMT 2014