AI Application Programming
 by Tom Copeland, in Book Reviews - Sat, Nov 15th 2003 00:00 UTC

Books on Artificial Intelligence (AI) have to walk a line between being too scholarly and too fluffy. Some books are very academic, with lots of formulas and symbols and a dearth of practical applications. Others are high-level, with much visionary hand-waving but no code. M. Tim Jones' book manages to maintain a nice balance between these extremes.

Contents

1. History of AI
2. Simulated Annealing
3. Introduction to Adaptive Resonance Theory (ART1)
4. Ant Algorithms
5. Introduction to Neural Networks and the BackPropagation Algorithm
6. Introduction to Genetic Algorithms
7. Artificial Life
8. Introduction to Rules-Based Systems
9. Introduction to Fuzzy Logic
10. The Bigram Model
11. Agent-Based Software
12. AI Today

What I liked

A book on AI has to begin with a discussion of what AI is and where it has been. The first chapter does just that, giving an overview of the history of AI from 1940 onwards, including the contributions of several of the major figures in AI research (Alan Turing, Marvin Minsk, and so forth). He also makes the point that this book is going to be about weak AI, that is, "features that have been added to systems to give them intelligent qualities", as opposed to strong AI, which involves attempts at making computers think like humans. This sets up expectations for a discussion of pragmatic usages of AI techniques rather than a defense of AI as a field of study.

This book covers ten fields of AI research in 350 pages, and surprisingly, it does it well. For example, the chapter on simulated annealing is only twenty pages long, but it's twenty pages of good material. There's an application of the technique to the n-queens problem, some charts showing the decreasing energy and temperature as a simulated annealing solution progresses, and some illustrative code snippets from the sample programs.

Each chapter is concluded with a one- or two-page summary and a list of some applications of the topic. For example, the chapter on genetic algorithms (GAs) ends with a note about a symbolic problem (Towers of Hanoi) and an actual problem encountered by the author (star tracking), both of which have been addressed using GAs. This provides enough information to be useful for seeding a Google search without being overwhelming.

The chapter I liked the best was on fuzzy logic. It's a short chapter (only twenty pages) but it has some nice diagrams of membership functions, a nifty chart of the predator/prey example, and a good discussion of the sample code. Furthermore, the sample code provides several membership function profiles, so it's actually useful outside of the example; it could serve as the beginning of a fully-functional fuzzy logic library. After reading this chapter and working through the examples, I've been able to understand some discussions in other AI books on the topic with no problems. Just one minor nit: The Fuzzy Control Language (IEC 61131-7) could have been given a short mention in this chapter, but there's only so much space.

The sample programs are what really made this book valuable for me. At least one sample program is provided to illustrate how each topic can be applied to a problem. The programs are written in compact, well-commented C (make files are included), and they ran without a hitch on my Linux workstation. I found myself reading a section of the book, tweaking a #define or two in the sample program, and recompiling and rerunning to see the effects. It's especially nice that the code is not overly complicated. There are some structs and some pointers, but no gratuitously complex uses of macros or setjmp()/longjmp(). The CD contains all the sample programs, and it only holds about 400K of actual data, so it's easy to copy the information to your hard drive and to get the samples compiled and running.

Note that the fact that lots of actual code is provided doesn't mean that there are no theoretical underpinnings discussed. The "Ant Algorithms" chapter, for example, spends a few pages discussing Hamiltonian graphs (i.e., the Traveling Salesman problem) and shows how the ant movement algorithm is structured. The other chapters are the same, a bit of theory followed by the implementation of a sample application.

What I didn't like

There were a few typos in the book. In one place, it looked like a code sample had been copied and pasted accidentally. The author provided me with an errata file, though, and the problems should be corrected in the second printing of the book (which was due in October 2003).

Translating the sample code

In order to study the book, I began a little Open Source project to translate the examples from C to Ruby. The author has been very supportive of this effort, and it's been a good review of C and has helped me understand the sample programs much better. I chose Ruby as the translation target because it's compact and reasonably fast, and its dynamic nature seems to lend itself well to AI programming. It's also nice not to have to compile the examples, since Ruby is interpreted.

As part of the translation project, I've included some general notes on translating C code to Ruby. There's nothing spectacular there, but there are a few things which have bitten me that other folks may find interesting.

Conclusions

If you're getting a PhD in computer science, this book will not go deeply enough into each topic to make you happy. But if you're a programmer who's interested in getting an overview of artificial intelligence programming techniques for use in your work, or if you're writing a game and you want to provide some semi-intelligent behavior for your non-player characters, this is an excellent investment. You'll get a good overview of how things work, and you'll have some sample code to show you how to get started.

Author's bio:

Tom Copeland started programming in Basic on a TRS-80 Model III, but demand for that skill has waned, and he now programs mostly in Java and Ruby. He's a contributor to various Open Source projects, including PMD, Cougaar, and GForge. He and his wife Alina have four children (Maria, Tommy, Anna, and Sarah) and live in northern Virginia.

T-Shirts and Fame!

We're eager to find people interested in writing articles on software-related topics. We're flexible on length, style, and topic, so long as you know what you're talking about and back up your opinions with facts. Anyone who writes an article gets a t-shirt from ThinkGeek in addition to 15 minutes of fame. If you think you'd like to try your hand at it, let jeff.covey@freshmeat.net know what you'd like to write about.

[Comments are disabled]

Referenced categories Topic :: Scientific/Engineering :: Artificial Intelligence

 Comments

[»] good review
by Philippe F. - Oct 25th 2005 17:55:18

I own this book, and I must say it is a good introduction book and it provide an overview of some important subjects, that you can then dig by yourself if you want to.

Get this one!

--
-- Philippe

[reply] [top]

[»] Great Book
by JimmyJim - Aug 10th 2005 10:04:38

i loved reading this and your right it kept a great line of understanding. What i liked best about it was its easy ot understand writings.

[reply] [top]

[»] tshirt famers
by jessica - Jul 31st 2005 04:37:58

Never got a reply sent an email months ago. I am webmaster for a non profit organization http://www.liversociety.org and can write and have thousands of pages I would like to publish.

[reply] [top]

[»] German translations?
by GulDukat - Sep 7th 2004 08:13:24

Anybody knows of a good german book or site about this topic ?
My english isnt that good to really understand such a complex thing when it is written in english. Maybe this book also has a translation into german? Thanx a lot
GulDukat
--
My little Site :)

[reply] [top]

[»] UK purchase
by BozMo - Jul 12th 2004 07:53:04

THe URL above only handles US purchasers. If you want to buy in the UK then the best I could find was Uk purchase Please note that I have no link with this purchase organisation BozMo

--
BozMo

[reply] [top]

[»] Wiki for AI
by Lion Kimbro - Jun 18th 2004 16:42:07

There are two wiki I know of for AI work: the AI wiki, and the AI Algorithms Wiki.

So, if you want to keep and share some notes with people as you learn about AI, check out those wiki! {:)}=

[reply] [top]

[»] Re: Wiki for AI
by modbot - Dec 9th 2004 08:59:08


> There are two wiki I know of for AI

> work: the AI wiki, and the AI Algorithms

> Wiki.

>

> So, if you want to keep and share some

> notes with people as you learn about AI,

> check out those wiki! {:)}=

Wow, I did not know about AI Wiki. Pretty Cool!


--
eYell.com :: Where the fun never stops Web Hosting Reviews

[reply] [top]

---

[»] Game AI
by Sean Middleditch - Nov 15th 2003 10:09:51

On a slightly different tangent, for those less interested in AI for acedamia and industry, and more for fun and entertainment, the book AI Game Programming Wisdon (Charles River Media, ISBN 1-58450-077-8) is absolutely excellent. Charles River Media has a bunch of good gaming programming/design books, including the excellent Game Programming Gems series. The AI Wisdom book is packed with tons of topics, including pathing, tactical analysis, racing/sports AI, learning systems, fuzzy logic applications, and tons more stuff. Very useful book if you like your games to have NPCs/enemies act a little more intelligent than those in Gauntlet. ~,^

--
-- What?

[reply] [top]

[»] Re: Game AI
by Tom Copeland - Nov 15th 2003 16:53:52

> AI Game
> Programming Wisdon (Charles River Media,
> ISBN 1-58450-077-8) is absolutely
> excellent.


Very true! There's a good chapter on fuzzy logic in that book, too, written by the author of FFLL.

[reply] [top]

---

[»] Re: Game AI
by Agent - May 8th 2004 01:44:31


> On a slightly different tangent, for
> those less interested in AI for acedamia
> and industry, and more for fun and
> entertainment, the book AI Game
> Programming Wisdon (Charles River Media,
> ISBN 1-58450-077-8) is absolutely
> excellent. Charles River Media has a
> bunch of good gaming programming/design
> books, including the excellent Game
> Programming Gems series. The AI Wisdom
> book is packed with tons of topics,
> including pathing, tactical analysis,
> racing/sports AI, learning systems,
> fuzzy logic applications, and tons more
> stuff. Very useful book if you like
> your games to have NPCs/enemies act a
> little more intelligent than those in
> Gauntlet. ~,^ Thanks for suggesting the book, i've just checked around for it and it seems to be a great find. I'll let you know how my reading on it goes :D

--
Real Estate - Rentals

[reply] [top]

---

[»] Related subject - Cognitive Architectures
by linux - Nov 15th 2003 01:42:41

Good piece, congrats !

Just want to add one thing - AI is not the only thing about "intelligence", there's another field known as "Cognitive Architectures" is making waves in the Robotic arena.

Many folks who are playing with Lego Mindstorm are applying the Cognitive Architecture approaches to make their robot to act a little bit more life-like.

You can obtain info from the following page: http://ai.eecs.umich.edu/cogarch5/

[reply] [top]

[»] Re: Related subject - Cognitive Architectures
by Sam - Nov 23rd 2003 17:06:10


> You can obtain info from the following page:
> http://ai.eecs.umich.edu/cogarch5/

Hooray for web pages which send HTML as text/plain.

[reply] [top]

---