Slashdot Log In
Digitizing Old Magazines?
Journal written by kesuki (321456) and posted by
timothy
on Sat Jul 05, 2008 06:00 PM
from the back-issues-with-back-issues dept.
from the back-issues-with-back-issues dept.
"I have a lot of old video game magazines, they're nice for playing 'classic games' because a lot of classics are impossible without the manual, and hard without a magazine (the magazine obviously negates the need for a manual usually). But they'd get damaged with a flatbed scanner, and digital cameras are hard to set up right for capturing old magazines. I know that old documents are digitally archived with very high-res cameras..."
So, the question is, what is the best way to capture all the information in old magazines in digital format? Does anyone have a home-built rig taking after the angled-pair-of-scanners setup that Project Gutenburg uses?
Related Stories
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
Same with old photographs (Score:3, Interesting)
I am scanning few of them from time to time, but there are way too much to manually scan each one of them. TIA
Re:Same with old photographs (Score:5, Interesting)
I suggest paying someone $5-$10 US an hour to scan the photos on a 300DPI flatbed scanner. Try an ad on CraigsList for your area. There are a lot of unemployed people with tech skills and no unemployment checks coming in that would appreciate a job like this for a day or two. How many photos would need to be scanned? Several dozen? Several hundred? Several thousand?
Usually adjusting the brightness, contrast, and gamma setting on black/white scan makes the image look good. I recently scanned all the images of my high school yearbook, put it on the web, and received thank yous from former classmates that I hadn't heard from in forty years.
Parent
Re:Same with old photographs (Score:4, Informative)
Minimum wage in the US (Federal) won't be $7.25 until next year. At it's inception in the early 70's, it wasn't indexed to inflation. If it had been, it'd be over $12 an hour. Some states set theirs higher than the federal and one or two are already a bit over $8. And on a "real" job, there are taxes - social security, medicare, workers comp, etc. come out of it. If you're paying someone $10 an hour, cash, they're essentially getting the equivalent of $15 or more on an over the table job. No benefits, which sucks, but if it's a part-time thing (like babysitting) someone's using to make ends meet or make a little extra money, it's not a bad deal.
Sure, paying someone under the table isn't legal, but for small stuff it happens all the time.
Parent
Re:Same with old photographs (Score:4, Interesting)
There are scanners which got feeder unit or there are some pro companies who can do such a thing with a price.
Software is important for such a project. For such a job, I recommend Hamrick's Vuescan, it has executables for Windows, OS X and Linux. Thing is, it will make things automatically.
http://hamrick.com/ [hamrick.com]
As I am perfectly happy with my el-cheapo Canoscan Lide 25 (upgraded from Lide 20 which had some accident), I went to Canon USA site to recommend such a scanner but it seems they have some mad invention there which they really failed to advertise.
http://www.usa.canon.com/consumer/controller?act=ModelInfoAct&fcategoryid=122&modelid=9888 [canon.com]
It installs to a Canon printer (which looks cheap) like a inkjet ink and printer becomes auto feed scanner. As I assume you got a scanner already, that solution could be a better thing. I am not sure about the quality though. I also don't know if Hamrick Vuescan or even Sane would ever support such a thing too. It is really worth looking into, perhaps see some demo or review from a trustable source.
Other solution is Xerox or HP multiple document scanners (with feeder). I would go with Xerox, I keep reading about HP driver horror stories.
Parent
He's trying to not damage it. (Score:5, Insightful)
Parent
Re:Same with old photographs (Score:5, Informative)
My wife is in the same boat as you - she had lots of slides (~3000) from her parents, lots of 35mm negatives (too many to count), and a bunch of photos (again thousands) from all different formats.
I ended up buying her a Nikon Coolscan V ED for her to scan in the 35mm negatives she has and her parent's slides. She has been very happy with it. I already had an Epson 2450 flatbed scanner...
She scans the slides, photos, and negatives while working on other projects in her office. The easiest tool I found for the photos is Adobe Photoshop CS (a bit expensive, but worth every penny - you could download a trial version from Adobe.) You put as many photos as can fit on your flatbed scanner (no need to straighten them perfectly), scan the photos, and then click on File --> Automate --> Crop and Straighten Photos - this will break up all the scanned photos into individual files, arrange them so they are straight, after which you can then edit and save each one.
Someone else wrote some instructions at http://photoshop911.typepad.com/help/2006/01/automating_crop.html/ [typepad.com]
There are probably some scanners where you can feed photos in - but some of the photos we have are irreplaceable (no negatives or copies.) We would not want to see them lost due to a scanner feed malfunction.
Also, do yourself a favor, and make backups of the work that you do. You would hate to lose all that effort due to a hard drive failure.
Best of luck!
Parent
Re: (Score:3, Funny)
You put as many photos as can fit on your flatbed scanner (no need to straighten them perfectly), scan the photos, and then click on File --> Automate --> Crop and Straighten Photos - this will break up all the scanned photos into individual files, arrange them so they are straight, after which you can then edit and save each one./i.
After scanning in nearly 7000 photos using Photoshop CS... how come no one ever tells me about these kind of things?
*facepalm*
Re:Same with old photographs (Score:4, Informative)
you might try these guys,
http://www.scancafe.com/works.php [scancafe.com]
basically you mail them all your negatives (i think they take prints too) and they scan em in india, put em online and you can choose which scans to keep, then you get your originals back in the mail with a disc containing your scans.
Parent
Re:Same with old photographs (Score:4, Interesting)
I recently rephotographed over six and a half thousand Polaroid photographs, google jamie livingston photo of the day if you are interested in the details, and scanning that many photographs on a flatbed scanner is crazy. Using a DSLR on a copystand I spent about 3 or 4 seconds per photo. Using a flatbed I could never get down to much less than a minute per photo, and a machine fed scanner was out of the question for 30 year old Polaroids. This was in 2004 , maybe scanners are faster now , but I doubt it.
Post processing is about the same for both , photoshop scripts to crop , straighten , remove dust and scratches , and open up the shadows could run in batch mode. I also wrote a batch that assembled them into 61 files to be printed out and assembled into a 8 foot by 120 foot display.
I also put the assembled version up on gigapan.org Search for it on for it on gigapan, it's interesting how different it looks assembled.
Parent
Destroy the magazines (Score:5, Informative)
Ok, you're going to hate me for saying this, because you feel they are collectors items, but really, they are just manufactured items made of bits.
So cut off the spines with an industrial paper cutter and put them through a sheetfed document scanner. Get over your attachment to paper.
If it's a special magazine that was signed by somebody or is rare, I could see keeping it. But otherwise it's a printout. The real value is in the information.
Now alas, these are probably copyrighted and can't be shared. If this were not the case this becomes a no brainer, because the "valuable" "original" would stay locked on your shelf, and the digital copy would provide value to many. It would be a strange devotion to the magazine to want to deprive so many of access to it in the name of preserving its "essence."
Scanners like the Internet Archive has are great, but they are expensive, and expensive to operate. As a result, fewer documents get scanned, and that's the tragedy, not the loss of the spine of a magazine.
Re: (Score:3, Insightful)
Now alas, these are probably copyrighted and can't be shared.
Depends. Who owns the copyright? It's possible the copyright was assigned to the publisher and that the publisher has since folded, or that if you contact the publisher and explain your position that you could get a release to archive it online, at least for the parts that the publisher holds the rights on (screenshots, boxcovers, etc. - that's different but will anyone care? Given the use, they're probably fair use as part of the magazine too). The other thing to consider is that it may not be possible for
Re: (Score:3, Interesting)
Re: (Score:2)
I have to agree, scan them in any way possible. Then seed to Underground Gamer, probably the best way to get it to people who will appreciate it.
Re: (Score:2)
That's the same thing I was thinking. Having said that, I don't think I could bring myself to do that to my comic collection. There is a certain amount of sentimental attachment that goes along with collecting, not to mention it's nice to have a hard copy, especially when your hard disk explodes, taking all the data with it. (Or your raid array gets struck by lightening, and your off site backup gets eaten by dingos... whatever. What? It could happen!)
Don't destroy the magazines (Score:4, Insightful)
I must respectfully disagree with the above reply. The magazine is not simply a print-out. It's an intact cultural artifact as a magazine. If not now, then in fifty or 100 years from now.
Are you primarily interested in the text of the magazine articles themselves? Or the images (such as 'Mens magazines' like Club International that are primarily images)? Or are you interested in preserving the balance in the layout between the text, the images, and the adverts?
For text primarily, use a stand for the magazine, and a 10 megapixel digital camera with a small tripod. Optical Character Recognition is the way to go in this situation. But it is hard to get the exact right program for your configuration.
Are these magazines in English or a western European language? OCR is much easier and faster with 100 or so ASCII characters than it is with Chinese, Japanese, or Korean. OCR for these languages exists but the programs are expensive if you actually buy them. Personally, I believe that because the Chinese have stolen billions of dollars worth of software from the Americans since the earliest days of computers, the Americans have no moral, ethical, or legal obligation to pay for any software developed and sold by a Chinese company. But, opinions differ on this issue.
Keep the magazines intact. You'll regret cutting them up in the future when a more elegant solution to digitizing them appears that doesn't entail destroying the original materials.
Parent
Re: (Score:2, Insightful)
Personally I feel that as the Americans "stole" millions of pounds worth of literature from the Europeans since the earliest days of books, Europeans have no moral, ethical or legal obligation to pay for anything developed and sold by an American company. But, opinions differ on this issue.
Re:Don't destroy the magazines (Score:5, Funny)
Europeans have no moral, ethical or legal obligation to pay for anything developed and sold by an American company.
Thems is invasion words.
Parent
Re: (Score:2)
Your Sinclair Rock And Roll Years (Score:3, Interesting)
Hello :)
My name is Nick Humphries, and I'm the owner of the Your Sinclair Rock'n'Roll Years. Although I'm posting as an AC, you can verify it's me by sending me an email via the website.
I agree with everyone saying "keep the magazines" - there's something about having the physical mags as a tangible connection to your childhood/the 80s/delete-as-applicable. The smell, the feel...
Anyway...
All I used was an ancient UMAX 610P flatbed scanner. No spines to worry about as all issues of YS are stapled together.
Al
Re:Don't destroy the magazines (Score:4, Insightful)
Wow, just wow. I have to say that I'm saddened and a bit dissappointed to find that anyone, anywhere thinks like that anymore. If you actually gave a little more thought to that line of reasoning, you would presumably have to concede that, for example, native americans shouldn't be obliged to pay for anything, given that their land was stolen from them several hundred years ago.
It is foolish, in the extreme, to punish anyone for the mistakes their predecessors made.
Parent
Re: (Score:3, Insightful)
"It's okay to steal wifi because the network door was left open"
Jeez, not that line again. It's great that you have morals, but then you should be willing to make moral distinctions and not call everything stealing. Sometimes when something is left open it is meant to be used. When I see a water fountain without a sign, I assume it's OK to use. If I'm wrong, someone might tell me. No harm done. We might not make the same assumptions about wifi, but if the owner intended it to be used openly, then it is not
Acutally in the digital age (Score:5, Interesting)
magazine and comic book companies are creating digital versions of the old magazines and comic books.
This might prove to be a business opportunity for a savvy geek that finds out what underwriting company owns the rights to defunct magazines like the Compute! series, and then buy the rights to them to reproduce them digitally. Usually some accountants and/or lawyers play the role of a corporate undertaker and buy out IP of failed companies. Then just scan the old magazines into PDF format, and sell them online for like $3 a copy to download the PDF version.
Some companies did that for the old 8 bit computers and game consoles, and made things like the Atari Flashback console or the Commodore 64 joystick by buying the IP rights to the games and the computer/console BIOS so an emulator can run inside of a tiny computer that fits inside of a game system or game controller hooked up to a modern TV set. Some companies also sell the ROMs online by buying out the IP for Atari arcade ROMs and other things.
Parent
Plustek OpticBook 3600 Plus scanner (Score:5, Informative)
I Use a Plustek OpticBook 3600 Plus scanner.
It allows scanning a book without forcing it flat.
The scanner itself is great, but be warned, the software is infuriatingly buggy, even in the latest release. Luckily there are work-arounds.
regards ........ Zim
Re: (Score:3, Informative)
A mirror? (Score:2, Interesting)
Scanning troublesome paper materials (Score:3, Informative)
Depending on the kind of binding which holds the spine together, I normally wouldn't hesitate to use a flatbed scanner to digitize them. Stapled mags are easier to work with than ones which are perfect-bound or have saddle-stitched bindings. From my POV, the collectibility of the analog original is irrelevant; all I'm after is the data itself, regardless of the physical container. As long as I accomplish a sufficiently high-res scan, I'm happy. I've occasionally removed staples prior to scanning or even sliced off the spines with an X-Acto knife. Of course I'd be far more gentle if the originals were not my own property. :)
For magazines which are bound too tightly (or are too large or fragile) to easily fit onto a flatbed scanner, you may have to consider setting up a photgraphic copy stand. You'll need twin lighting sources on each side of the stand, angled downwards at 45 degrees. The stand should have a screw fitting to mate against the base of your camera body. Reflections from glossy magazine pages may have to be eliminated via use of a circular polarizing filter added to your camera lens. I'm not sure how you'd weigh down the edges of the mag, though...slabs of a transparent material such as lucite or plexiglass? I don't envy anyone who needs to go down this route to take digital photos of the mag pages.
How? (Score:2)
Re: (Score:2)
How are these going to be damaged by a flatbed scanner?!? Most game magazines have only been around for ~20 years, max. And I don't see how the heat would be an issue...
To lay them flat, you pretty much have to break the spine.
I don't lend my dad books anymore because the first thing he does is break the spine.
If the submitter is really attached to his dead trees, he might consider buying one of these:
http://gizmodo.com/gadgets/gadgets/copyright+violating-scanner-is-designed-for-books-235382.php [gizmodo.com]
Classic Comics too (Score:3, Interesting)
No, I will NOT slice the spines.
The idea of 2-part solution where my digital camera is mounted and a separate stand that holds the comic perfectly is appealing. The solution would have to enable rapid turning of pages and the pages will have to remain as flat as possible.
A non-glare glass plate that does not reduce picture quality is probably too much of a dream, but I'm open for suggestions.
Give me some ideas and I may donate the images to Guttenberg or other worthwhile repository.
Re: (Score:2)
actually, the glass(plastic, whatever) plate from a flat bed scanner would be good for holding the page flat, i'm actually considering tearing up my old flat bed scanner and going with a digi cam/tripod, and a stand with the remains of the flatbed scanner to hold the pages flat.
i'm wasn't going to do OCR work, the pictures are important to the text, IMO.
i'm not cutting them apart, and yeah scanners take to long.
Re: (Score:3, Insightful)
A non-glare glass plate that does not reduce picture quality is probably too much of a dream, but I'm open for suggestions.
If it was me, I'd undo the staples, scan, reassemble. I presume this is not an option.
But scanner or photocopier glass, a ring light. It would be the way I'd go about it. 8MP cameras are common. You might want to go SLR, something like a Pentax or Nikon where you can get the a stock manual focus 50mm. For something that is, I presume, 9x7 inches I doubt you need a macro lens. I didn't say Canon as the mount changed from the manual focus days, but that's an option as well, just good bang for the buck w
Let me guess... (Score:5, Funny)
ambient light, tripod, shutter release remote (Score:5, Interesting)
A few things:
Re: (Score:3, Insightful)
3.1 If your camera has a mirror lockup mode, use it.
Not anonymous (Score:2)
It says right on the title:
Journal written by kesuki (321456) and posted by timothy on Saturday July 05, @04:00PM
Re:ambient light, tripod, shutter release remote (Score:4, Interesting)
Parent
Remove the staples (Score:2)
So, the question is, what is the best way to capture all the information in old magazines in digital format? Does anyone have a home-built rig taking after the angled-pair-of-scanners setup that Project Gutenburg uses?
Unless we are talking about glued binding like national geographic uses, odds are we are talking about something stapled. Remove staple and use either a sheet fed or a flat bed scanner. Replace staple.
If that's not an option, then one can setup a photograph rig where you place the camera on an arm at a right angle and press down each page with a piece of glass. 8MP cameras are common place which AFAIK are going to be slightly better than 300dpi.
Copy stand... (Score:2, Informative)
Someone might have beat you to it (Score:3, Informative)
Computer Gaming World put up the first 100 issues in pdf form when they switched to Games For Windows Magazine. I know there is an effort (if they haven't already succeeded) to scan in every issue of Nintendo Power. There is a lot of other stuff out there too.
Look around for them and it might save you the time of scanning them in yourself.
Team of monks (Score:3, Funny)
Rent a monestary. It's slow, but it'll add some value to your magazines.
"Gaming" magazines? (Score:2)
How I do it... (Score:5, Interesting)
I run fromoldbooks.org [fromoldbooks.org], a Web site devoted to scanned pictures and text from old books -- some more than 500 years old.
I use an Epson Expression 1000XL flatbed scanner (A3+ resolution, approx 12x17.5" with colour calibration), Linux xsane and gimp, for most of the images, but this does involve damaging the binding of thicker books. I scan wood engravings usually at 2400dpi, but modern screened pictures at only 1200dpi or sometimes even lower. The idea that you only need to scan at twice your print resolution assumes (1) you know what printer you'll use 10 years from now, (2) that once you scale down by more than 50% there's no visible difference (false). For colour you will need to do some descreening, which will generally involve something like an 11 to 17 pixel radius gaussian blur followed by a sharpen.
I also use a Canon 450D (Digital Rebel) camera on a tripod, with a 50mm f/1.8 lens (you can get the lens for around $75 to $100 in US or Canada, less if used) and a remote control; use the mirror lockup function of the camera and the remote to minimise camera shake. I point the camera at the open book.
In either case if there are significant amounts of text I then use Abby FineReader OCR; the open source OCR programs (and most of the other commercial programs) are a waste of time by comparison, or at least that was true 2 years ago when I was last researching this.
Go and buy a couple of large USB external disk drives, e.g. 500GBytes or more, and also write DVD backups frequently. Use a consistent naming scheme; I use a separate directory (folder) for each book or magazine, and I include the page number in the filename, together with -raw for the origial scan and -cleaned for the processed version. I use PNG to save the files because it's lossless, an open standard, and widely supported; I'd suggest avoiding GIF (not enough colours), TIFF (portability problems) or JPEG (lossy).
Obviously if you want to put the magazines on the Web you'll need permission; in my case I am usually digitising out-of-copyright books, although copyright laws have changed since I started, and also my understanding of copyright has changed. E.g I started out believing Wkipedia :-)
It can be a big project, but a lot of fun!
Re: (Score:2)
+1 Funny. Too bad I am out of modpoints
Re:Wouldn't that be copyright infringement? (Score:5, Informative)
Parent
Re:fair use? (Score:5, Informative)
No, you could not "easily lose that fair use argument" in a courtroom with regard to this situation. Now, if you went out and distributed copies of the material, you've broken copyright law and would be wide open to civil actions.
Should you happen to continue to assert your position on this matter, cite supporting examples in case law.
Parent
Re:fair use? (Score:5, Insightful)
Parent
Re:fair use? (Score:4, Insightful)
Why must lawyers be consulted before every action may proceed? Life is for living.
Daydreaming 50 years into the future..
*checks with lawyer*, *exhales*, *checks with lawyer*, *inhales*, *coughs*, *brain-implement logs: INFRINGEMENT DETECTED $50 fine*
Parent
Re: (Score:3, Insightful)
Interesting how the comments questioning fair use are generally moderated "1", while the ones insisting that of course making personal backups is fair use get moderated "5".
Anyway here's what the EFF, not exactly a bastion of copyright absolutists, says in their Fair Use FAQ [eff.org]:
Copyright is theft (Score:2)
So who cares ;)
Re: (Score:2)
I've found gscan2pdf to be excellent for doing automated (via a document feeder) or semi-automated (flat bed scanner or other source) scans to pdf format and it supports importing from jpg or other formats. It also supports OCRing if you have gocr or tesseract installed (I recommend tesseract as an excellent OCR utility). I'm not sure if this is available for windows, though, you may have to have GNU/Linux to use these programs.
Oh yes, and it even can properly paginate all the scans of a double sided docu