Books on Programming Theory? 85
subversionfactor asks: "I am a philosophy student with an intense interest in mathematics and programming. However, while I've always been able to find books about various experimental areas of mathematics, I've never seen (m)any on the subject of programming theory. Most bookstores' "Tech" sections only include how-to books and books about why dot-coms failed. Does anyone in the Slashdot community have any recommendations for books dealing with any aspect of programming theory?"
The Definitive... (Score:5, Informative)
Re:The Definitive... (Score:2)
Re:The Definitive... (Score:5, Informative)
Re:The Definitive... (Score:1)
Re:The Definitive... (Score:1, Informative)
Re:The Definitive... (Score:2, Informative)
Re:The Definitive... (Score:1, Offtopic)
Cliff next time do a search one google to see if the answer is in the top ten.
Also it is algorithm theory not programming theory, as programming theory is how people program, not what they use to get the answer to the problem.
Re:The Definitive... (Score:1, Offtopic)
Cliff has to make his quota or he loses his job.
Why do people hate Muslims?
What people? That's pretty vauge.
-Bill
Perhaps you should look in the right section... (Score:2, Informative)
Our programming languages class had us learn a crapload (scientific term) of languages in one semester, and while I don't remember them all, or even how to code in them, I learned a lot about the underlying theory behind coding and the different paradigms.
I wish I could find the book we used in the class, but amazon has the following which looks interesting: http://www.amazon.com/exec/obidos/tg/detail/-/071
Re:Perhaps you should look in the right section... (Score:1)
Re:Perhaps you should look in the right section... (Score:1)
You don't just learn a lot of languages and then have the theory click, and you can't just learn the theory and have the languages fall into place. Rather, it's a combination of both. Just like learning to read, it's a combination of sounds and grammar.
No matter how easy people want to make it, for some folks programming is just too complex and their brains aren't wired to understand it.
Two titles (Score:5, Informative)
Art of Computer Programming, v1-4, Knuth (ok, so this is three titles)
Re:Two titles (Score:5, Informative)
Obvious and non-obvious (Score:5, Informative)
"The Art of Computer Programming" by Knuth
"Programming Pearls" by Bentley
"Godel, Escher, Bach: An Eternal Golden Braid" by Hofstadter
"The Tao of Programming" [canonical.org]
Jargon File [tuxedo.org]
Re:One word: Knuth. (EOM). (Score:1)
Theory (Score:5, Interesting)
"The Elegant Universe" - Greene
"Hyperspace" - Kaku
"The Bit and the Pendulum" - Siegfried
"The Structure of Scientific Revolutions" - Kuhn
"The Advent of the Aglorithm" - Berlinksi
"Orality & Literacy" - Ong
"Genome" - Ridley
"Philosophy of Mind" - Kim
Scientific American - Every issue
"Artificial Intelligence [A Modern Approach]" - Russel & Norvig
"Computer Organization & Design [The Hardware/Software Interface]" - Hennessey
And then of course Plato [The Republic, Timaeus & Critias, Phaedrus, etc..], Descarte [Meditations,
While non of these books will make you a better programmer persay, they all will make you understand how things relate, how to approach topics, and what people will get out of things...
agree, disute, add (Score:3, Interesting)
wicked looking list.
not every issue of scientific american has dealt with programmming. maybe i'm biased because i read it throughout the 70's and 80's, but not so regularly in the last dozen years. maybe i'm jsut showing my age.
add this one: "The Society of Mind" - Marvin Minsky.
totally readable non-technical look at AI. brought to my attention by a geographer.
Re:agree, disute, add (Score:1)
The school I'm in at NYU (Gallatin) is an 'individualized studies' school -- so you get to basically pick and choose what you want to take. The catch is that in order to graduate you need to have a 2 hour talk with 3 professors explaining what you've done in the past 4 years, using atleast 20 books, 7 coming from before the 1600s, 4 humanities works after the 1600s, 4 social & natural science works after the 1600s, and 5 from your 'area of concentration'. So I've been staying up late developing a booklist and a theme of what I want to discuss.
The thing is, if I transferred to CAS (the arts & science school), I'd have more than enough credits to be a Comp Sci major -- that's not what I want though. I'm interested in how computers have changed thought, and how design patterns relate to social & life patterns. You can imagine how ecstatic I was when I saw this 'Ask Slashdot' question. I already purchased the Goedel Escher Bach book (should be here tomorrow), am probably getting the "Origin of Objects" and will most definitely get the Knuth book[s].
I've essentially decided that my focus is going to be 'The Development of Abstraction' -- from unordered random information to concrete working/usable information to abstract essences. It's basically the pattern that everything goes through, from a child becoming an adult to the universe creating life. Atleast those are my thoughts.
Anyway... if anyone would like to add some more books to my list, or ideas to focus on, I'd be forever grateful.
Re:Theory (Score:2, Interesting)
You might also want to browse some of the stuff at Edge [edge.org] which is right in the middle of this field. The authors who contribute there have a book called 'The Third Culture', sorry I can't give you an ISBN but UI can't find a copy myself. It's aimed as a bridge between areas in the arts and sciences. Some of the papers in it (which are on the site) are good non-technical discussions of AI/programming and the philosophy behind it.
Re:Theory (Score:1)
Best beginner's books (Score:2)
All are absolutely first-rate books.
From another Phil major (Score:5, Interesting)
I'm going to (a) give you a fish and (b) teach you how to catch more.
(a) Introduction to the Theory of Computation (Sipser, Michael; 1997, PWS Publishing Company; ISBN 0-534-94728-X; QA267.S56 1996b 511.3 --dc20; amazon page here [amazon.com]) is a fantastic volume. We used it in a comp sci course I took, and is probably the only book from my dint in c.s. that I won't sell. This, however, brings us to the bit about fishing:
(b) Find out what courses at your university offer comp. sci theory, and then either (i) take the course (possibly pass/fail), or (ii) borrow their reading list. Contrary to your experiences in phil, virtually all (comp?) sci lectures are simple verbalisations of some gigantic glossy textbook. Those guys in the faculty of Science have far less interest in primary sources than we do; class time is not spent carefully teasing apart inscrutable two thousand year old sentences when a big glossy manual with colour diagrams are available.
In addition (Score:5, Informative)
On the Origin of Objects (Score:3, Informative)
On the Origin of Objects
MIT Press
ISBN: 0-262-19363-9 (HB) 0-262-69209-0 (PB)
An exploration of object oriented programming turned philosophic inquiry. I've only read the first half; as a double major in Philosophy and CS I had to stop reading it so that my senior CS project did not devlove into a philosophy paper.
Martin Davis, Engines of Logic (Score:4, Informative)
In my opinion, it strikes the perfect balance for a book of its kind between readability and technical detail. And, based on who wrote it, you can be sure that the tecnical detail is correct. Depending on what you mean by "programming theory", I'm not sure if this is exactly what you are looking for. But based on your stated background, I'm sure you'll love it.
The best ever book on computer programming... (Score:2, Funny)
Re:The best ever book on computer programming... (Score:2)
Re:The best ever book on computer programming... (Score:2)
"Computer Power and Human Reason" (Score:1)
Related Philosophic Bibliography (Score:5, Informative)
For semantics, I don't have any good sources to refer you to, as I've only got lecture notes explaining the basics, but you want to look for discussion of "denotational semantics" These are discussed most in the functional language community. The Scheme spec (r5rs) has a denotational semantics for the language. "Monads" are also an area of some interest... but monads and category theory may be leaning more towards the mathematical side.
Another related article:
Rayside, Derick, Gerard T. Campbell
"An Aristotelian Understanding of Object-Oriented Programming"
OOPSLA '00 10/00 Minneapolis, MN USA
[conference procedings]
http://citeseer.nj.nec.com/rayside00aristotelian.
Here are two cites ripped from a course web page somewhere:
J.C.Reynolds, Theories of Programming Languages, Cambridge University Press 1998, ISBN 0-521-59414-6
D.A.Schmidt, Denotational Semantics: A Methodology for Language Development, WCB Publishers, Dubuque, Iowa 1988, ISBN 0-697-06849-8
A few other things that may or may not be of interest in object oriented areas:
Black, Andrew, Jens Palsberg. Foundations of Object-Oriented Languages ACM SIGPLAN Notices. Volume 29, No. 3, March 1994.
Cook, William R., Walter L. Hill, and Peter S. Canning. Inheritance Is Not Subtyping. in Theoretical Aspects of Object-Oriented Design. ed. Carl A. Gunter and John C. Mitchel. MIT Press, Cambridge, Mass.: 1994.
Danforth, Scott, Chris Tomlinson. Type Theories and Object-Oriented Programming. ACM Comput-ing Surveys, Vol. 20, No. 1, March 1988, p. 29
The Pragmatic Programmer: From Journeyman to Maste (Score:4, Interesting)
This book is an excellent distillation of practical experience and advice covering all phases of software development. While it's written mainly for the software developer, project managers will get valuable insight from the book on effective software development practice. The strength of this book is that it draws heavily from the authors' experience. Rather that promote a methodology, it promotes attitudes, values, tools and proven practices that will help anyone become a better software developer and make the job of software development more creative and stimulating. It's especially good for new software developers as it contains many lessons that experienced developers only learn the hard way. The book is well organized in easily digestible segments, with a very good cross reference system that makes it handy for repeated use. The appendix presents many valuable resources that professional programmers will want to explore.
I actually got introduced to it because the same guys later went on to write a pretty decent Book on Ruby [amazon.com]. However useful that book was to learning Ruby, The Pragmatic Programmer was useful to fostering a positive set of habits and attitude toward programming in General. At least do yourself a favor and read the rest of the comments on Amazon.com before dismissing this underrated classic!
basically, you want early analytic philosophy (Score:5, Interesting)
You'll see a lot of the genesis of proto-computer-science in Frege and Wittgenstein. Of course, it comes out full bore in Church and Turing. Any graduate-level logic text should cover combinatory logic (basically, with the lambda-calculus, the basis of functional programming). One such text (that I can recommend) is _Computability and Logic_, by Boolos.
Of course, SICP (as recommended elsewhere) is excellent, and the Sipser book (likewise) is a readable introduction to theory of computation.
What are you interested in? If you're interested in models for computation, check out the logic books. If you're interested in types (a la Russell), contrast logical types with PL types by reading Luca Cardelli's "Type Systems" (available online free from citeseer, use google). If you're interested in algorithms, Sedgewick or the massive MIT Press algorithms book is good.
You can't be hurt by reading the fundamentals, either: Church, Turing, Rosser, anything by Burstall or Hoare, and (if you're in for some fun), PL semantics (the seminal work in this area is Strachey/Scott). There is a good book available online called "Semantics with Applications" or something similar; I believe that the authors are named Nielsen.
Be careful, though. I was an undergrad philosophy major, and now I'm a grad student in programming languages.
I wonder... (Score:4, Insightful)
Not that they are bad books. I actually enjoy reading them and I'm working my way through the first one. The only problem is I can only get through about 5 pages before falling asleep (reading before I go to bed). Also, a suggestion if you're planning on reading any of these: keep a pad of paper and pencil nearby.
Oh, also for people who want slightly lighter reading, but still good. Check out Algorithms in C or Algorithms in C++ by Sedgewick. Very good books (same book different languages) and very easy to read. Also, I believe this guy and his coauther were students of Knuth at Stanford.
Re:I wonder... (Score:1)
Of course, as Knuth himself quotes from Abel in one of the volumes of TAOCP (all of which I've read
(In answer to a question on how he got his experience)
"By studying the masters and not their pupils"
Re:I wonder... (Score:1)
Dijkstra! (Score:5, Informative)
I am a philosophy student with an intense interest in mathematics and programming...Does anyone...have any recommendations for books dealing with any aspect of programming theory?
It sounds like you are looking for Edsger Dijkstra's A Discipline of Programming [amazon.com], which is great fun if you can juggle math, logic, philosophy, and programming (in a non-deterministic language he made up for the book) without getting fixated on any one to the exclusion of the others. He starts with an interesting angle on why we have computers at all, and builds up from there.
-- MarkusQ
Re:Dijkstra! (Score:1)
Object Oriented Software Construction (Score:2, Informative)
Eiffel is used for the examples, but it is a comprehensive work on OO Design applicable to any OO language.
Definitely worth reading.
The Practice of Programming (Score:2, Informative)
by Brian W. Kernighan and Rob Pike
Re:The Practice of Programming (Score:1)
Re:The Practice of Programming (Score:1)
I liked this one (Score:2)
David Gries, The Science of Programming, Springer. (Score:4, Informative)
"This is the very first book to discuss the theory and principles of computer programming on the basis of the idea that a proof of correctness and a program should be developed hand in hand. It is built around the method first proposed by Dijkstra in his monograph The Discipline of Programming (1976), involving a "calculus for the derivation of programs." Directing his materials to the computer programmer with at least one year of experience, Gries presents explicit principles behind program development, and then leads the reader through example programs using those principles. Propositions and predicate calculus are presented as a took for the programmer, rather than simply an object of study. The reader should come away with a fresh outlook on programming theory and practice, and the assurance to develop correct programs effectively."
Color me stupid... (Score:1)
Information comes in, it gets processed and goes back out.
Anything more complicated than that starts getting into the whys and wherefores of the particular hardware/OS/compiler/libraries/languages you're working with.
There's best practices, sure, but theory?!? Somebody tell me what I'm missing in this question...
Re:Color me stupid... (Score:5, Informative)
Compare the work done by a bubble-sort to that of a quick-sort. This is independant of OS, compiler, library, and language. Good algorithms are above such details. When you're dealing with basic tasks like sorting, hashing, indexing, graph theory, list manipulation, etc., there are many fundamental theorms that transcend the particulars of the compiler or operating system. And many complex problems can be broken down into these sort of basic primitives.
I'm not implying that programming is all about these theoretical details, because it's not. But understanding the theory is an essential tool for being able to optimize a loop, write a library, or fix code in any case where time and space (i.e. code length) is of any concern.
Re:Color me stupid... (Score:1)
There isnt... (Score:1)
well, although there are a lot of good refs and *ptr here, i never found such a book full filling what you have asked for (methinks).
why? well i guess it depends on what -exactly- you're looking for. but you dont look for something specific... "Programming Theory". Maybe you're looking about a book about algorythms? Again, there's a bunch of books you can find on the net, try "algorythm site:ru" on google and there hundred of books you may drop an eye on.
Again what's in an algorythm? it's a way of solving a problem in reguard to the tools you have to do so. Try to use the same algo with assembly (which one? 6502, 680x0 or 80x86 or
i remember having asked to my mother how much pili-pili to put in the fish-soup... she said, shoked, "just taste it, you dumb!"
cant help on this one
---
http://freddo.netfirms.com/ [netfirms.com]
---
Re:There isnt... (Score:2, Interesting)
btw, about phi-psychology, is there any good book about reprogramming humans?
advertising, propaganda, oh and `social engineering`? any general algo to exploit those stupid wetwares? we should be more open to what sect and religion do, there's surely some money to get there...
i wonder what OS we're running on, definitively if there's a god, he's a bad coder... sadly, with my job status i probably cant judge...
---
http://freddo.netfirms.com/ [netfirms.com]
---
Reprogramming humans (Score:1)
Note - this is fiction.
Well it is currently fiction.
Re:There isnt... (Score:1)
Thanks a lot for your pointers, i just received the John Lilly book and it looks really interresting!
i also found a lot of stuff just googleing for the authors. thanks again.
freddo [netfirms.com]
A huge area (Score:1)
To start off with I'd recommend a book about Logic. After this one can go onto Computation Theory (Turing/Church etc) and Complexity. These need a fair amount of Discrete Maths.
AI is often a favourite area for philosophers (much to the annoyance of my lecturer as they never actually study it properly). This is again a huge area in itself, we've been recommended "Artificial Intelligence: A Modern Approach - Stuart Russell and Peter Norvig"
See if you can find some lecture notes as well, many universities put the on the web (try http://www.cl.cam.ac.uk/)
A book about theory of computation (Score:1)
Hopcroft, J., Motwani, R., Ullman, J., Introduction to Automata Theory, Languages, and Computation, 2nd edition. Addison-Wesley Publishing. 2000. ISBN: 0201441241.
Amazon information can be found here [amazon.com].
Re:A book about theory of computation (Score:1)
Wolfram 's book (Score:4, Insightful)
Code complete by McConnell - very much about the practice, not so much about the theory, but still useful.
Software Engineering - a practitioners approach - useful overview.
Bentley's Programming Pearls - down n dirty.
How about Nicklaus Wirth? (Score:2, Informative)
They exist... (Score:3, Interesting)
The first book try to condense modern computer science into a few hundred pages written for a layman (much like "A brief history of time" does it for physics). The second combines everything interesting (Art, music, mathematics, philosophy, literature, genetics, etc), with programming, and is among the most interesting books I've ever read.
The foundations of programming in Scheme is covered quite well in "Abelson & Sussman: Structured Interpretation of Computer Programs" [mit.edu]. But this is only one view. You may also want to read "Bertrand Meyer: Object-oriented software construction" for a relatively different view (more mainstream). Of course, when it comes to programming, there are no hard facts, and people tend to have a lot of differing opinions.
Functional programming and logic programming arose out of a need to make programming more like that of writing specifications, to make it easier to construct mathematical proofs. It would be a good idea to look into that as well. I can recommend "L. C. Paulson: ML for the working programmer" as a good introduction to functional programming. There are also a number of good books on Haskell, please pick one. When it comes to logic programming, things are unfortunately a bit more messy. The main logic programming language, "Prolog", is all but logical. Also, most research these days seems to focus on constraint programming, which is a generalization of logic programming. For a good online introduction, check out Oz Mozart [mozart-oz.org].
The foundations of mathematics (logic, set-theory, category-theory, etc) are all important in computer science. And of course also more mundane subjects such as combinatorics, calculus, etc...
Logic relates to programming, as mathematics do to engineering. While formal methods have not had much practical value so far, it's an important part of computer science, and undoubtedly something that should become important sometime in the future, once we find a practical way to do it. The best place to get the basic ideas are still "Edsger Dijkstra: A discipline of programming". It's more than likely that you local CS department offers some courses.
Since your view is from philosophy, I guess you are more interested in the important insights of computer science, rather than the boring details. In that case, I can also recommend: "Papadimitrou: Computational Complexity" which covers more or less the same stuff as Harel's book, but in a bit more in depth. It would be good to have read a basic book on algorithms first (basically any will do, but I can recommend the books by Sedgewick, or Cormen, Leiserson & Rivest). By this time, you should be able to find your own references in computational complexity and algorithm analysis.
If you're just starting out... (Score:1)
The Pattern On The Stone by Daniel Hillis is a good introductory text on what it is exactly that computers are doing, and a solid introduction to some other topics such as genetic algorithms and chip design. It's only short, but I got a lot out of it (and this was two years into my BSc which had covered quite a lot of AI and programming by then).
Programming Language Theory Weblog (Score:1)
Programming theory covers everything from theories of computation to software engineering. Assuming your more interested in the former than the later I suggest looking at the programming language theory weblog Lambda the Ultimate [weblogs.com].
Three simple words: Turing Turing Turing (Score:2)
Programming Language books... (Score:2)
http://www.cis.upenn.edu/~bcpierce/tapl/index.htm
(This doesn't cover computability and complexity, etc., rather, it really is about the act of *programming*.)
Book on the Computer and Metaphysics (Score:1)
Heinz Pagels, the late physicist, wrote a book about how computer modeling was influencing fundamental we imagine the world. I believe the title is Dreams Of Reason.
Look at Quantum Computing (Score:2)
The Deadline (Score:1)
One of my favorite books on Project management. This book is a work of fiction by one of the great authors in Computer Science. This book is a work of Fiction, where the books main character is kidnapped by the ruthless King Bill (who just spent his money buying a country), and forced to manage a team of engineers producing knockoffs of popular desktop applications.
You might recognize some of the other cameo appearances as well. This is a great read, perfect for a flight on a business trip, or handed to any manager you might find yourself working for.
I will add a few that have not been mentioned. (Score:1)
Snow Crash.
Neuromancer.
The Mythical Man Month.
I also recommend that you pick up the hardcover copies of the AD&D Second Edition and learn to play, spend a few weekends playing from dusk to dawn. You would be amazed at how many real programmers used to play RPGs. AD&D (dungeons and dragons) is a game that can only be played successfully if you read through and memorize all 6 manuals, understand the system from the back end, remember where to (quickly) find a rule that supports what you need to do - generally hidden in the larger volumes (books total maybe 1500 pages tops.) You learn to twist the system to do what you need it to do, all the while struggling with random events or malicious other people.
Just like programming.
Automated Reasoning (Score:1)
Anyhow, there are two texts I'm using right now. I don't have them with me, so I'm working from memory right now, but I believe both are titled Automated Reasoning. The first was written by Wos and others while the second was written by Chang and Lee.
I've enjoyed it a lot so far. The authors use very different approaches - Chang and Lee are very formal and the book reads like a typical math text. Wos, on the other hand, is very chatty. Neither of them relies on a specific implementation of automated reasoning, so you should be able to apply what you learn to any application.
They both start by building from basic Boolean logic, introducing better models, and explaining their limitations. As somebody with a strong math background but little experience with programming or automated reasoning, I've found them both easy to follow and understand.
Anyhow, enjoy.
Canonical Tomes (Score:2, Informative)
programming theory (Score:1)
"The Advent of the Algorithm [maa.org]" - David Berlinksi
A quirky, very accessible treatment of the link between mathematics and computation.
"Concrete Mathematics [marypat.org]" - Ronald Graham, Donald Knuth, and Oren Patashnik
If you're hard-core about the mathematical aspect.
"Object-Oriented Analysis and Design with Applications" - Grady Booch [rational.com]
If you're interested in OO.
Books by or about:
alan turing
godel
noam chomsky
claude shannon
Programming Language Theory & Philosophy (Score:1)
In addition, I agree quite strongly with those who recommended MIT's Jargon File, and I direct your attention especially to the entry for "molly guard."
You should also try S. I. Hayakawa's Language in Thought and Actio [amazon.com], and you should definitely consult The Word Spy [wordspy.com]. The first is one of the classics in the field of semantics; the second logs the appearance of new words and phrases (frequently tech-related), and explains the concepts behind them.
The Pragmatic Programmer (Score:2)
Colleges? (Score:1)
I am a senior in high school. I also am interested in math, philosophy, and computer programming. In addition, I like political science. I don't really know what to major in. Can anybody suggest any good majors or colleges for me, please?