Webbots, Spiders, and Screen Scrapers
A Guide to Developing Internet Agents with PHP/CURL
The Internet is bigger and better than what a mere browser allows. "Webbots, Spiders, and Screen Scrapers: A Guide to Developing Internet Agents with PHP/CURL" is for programmers and businesspeople who want to take full advantage of the vast resources available on the Web. As author Michael Schrenk demonstrates, there's no reason to let browsers limit the online experience -- especially when it's so easy to automate online tasks to suit individual needs.This new book begins by outlining the deficiencies of browsers, then explains how these deficiencies can be exploited in the design and deployment of task-specific webbots--customized programs that aggregate different sources, filter content for relevant data, and automate online transactions.
Inside "Webbots, Spiders, and Screen Scrapers," readers learn how to write fault-tolerant webbots and spiders that:
-download entire websites and parse data from web pages
-manage cookies and decode encrypted files
-automate form submissions and send and receive email
-send SMS alerts to cell phones
-unlock password-protected websites
-automatically bid in online auctions
-exchange data with FTP and NNTP servers
Sample projects reinforce these new skills so readers can create simple Web applications to track online prices, create anonymous browsing environments, archive online data, and more. In addition, the author's website (www.schrenk.com) provides readers with sample scripts and code libraries, as well as a place to test their own webbots.
"It can be difficult to learn how to design, develop, and deploy webbots," said No Starch Press founder Bill Pollock. "Mike Schrenk has been living and breathing this stuff for many years and is the perfect teacher to share his accumulated wisdom."
As "Webbots, Spiders, and Screen Scrapers" illustrates, some tasks are just too tedious -- or too important -- to leave to humans. With guidance from author Schrenk on how to automate online life, readers won't let a browser limit the way they use the Internet again.
Michael Schrenk develops webbots and spiders for clients across North America. He has written for Computerworld and Web Techniques magazines and has taught college courses on Web usability and Internet marketing. He's also an occasional speaker at DEFCON.
Webbots, Spiders, and Screen Scrapers: A Guide to Developing Internet Agents with PHP/CURL
by Michael Schrenk
Apr 07, 328pp, US$39.95, Available in bookstores everywhere.
Download: Sample chapter
ABOUT NO STARCH PRESS: Founded in 1994, No Starch Press (nostarch.com) is one of the few remaining independent computer book publishers. We publish the finest in geek entertainment--unique books on technology, with a focus on open source, security, hacking, programming, and alternative operating systems. Our titles have personality, our authors are passionate, and our books tackle topics that people care about. No Starch Press titles have been selected for the prestigious Communication Arts Design Annual and STEP inside 100, and have won the Ippy Award from Independent Publisher magazine. Visit nostarch.com for more information and our complete catalog. (And most No Starch Press books use RepKover, a lay-flat binding that won't snap shut.)
.
Return to &Else News & Views. . .
.
Participate in your Design Center
Lots of fun and information for all... don't forget, any community is only as good as the participation of its members. We invite your tips, tricks, comments, suggestions and camaraderie.
- Ask for the DT&G Monthly: to receive DT&G newsletter each month, happenings in the Design Center and regular columns like the "Mail Bag" and "Cool Sites"
- Discuss Design & Desktop Publishing : in the Designers' CAFE
- Link to this site, and then show us the link. We'll send you any of our current door prizes, just for your trouble.
- Discuss Photoshop at Photoshop 911
- SUBMIT: a news link, new font, or product review
- REVIEW a website: posted by our readers
- SUBMIT a Website: for review in Web Design & Review
- Submit a Critique: of a popular web site, or YOUR web site!
- WIN PRIZES: in our "Question of the Month" column
- Meet Friends of the Design Center people who care!
- Become a Friend of the Design Center: and put your link on the front page
- Submit News, Views or your latest press release
- Submit your Software Review: shareware, freeware, fonts, graphics, utilities -- if you've found software you like, let DT&G readers know about it!
Learning, training, tips, tricks, and moreThe Design Bookshelf team reads and reviews the best books for the creative visual designer, desktop publishing practitioner and visual communicator. If you want to know it -- we'll show you the very best way to learn it... in the Designer's Bookshelf
Get more out of your computer: join a user group - There are computer clubs around the world called "user groups" where you find fellow computer users ready and willing to share a wealth of information. If you're not a UG member, you should be.. find a group at the User Group Network
Photoshop FAQ - Got a question? Get an answer: in the Photoshop 911 FAQ if you don't find the answer there, you can ask your question or send your problem to the Photoshop 911 Team