|
| If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. |
|
|||||||
| Tags: duplicates, file, large, pgn, removing, tool, unix |
|
|
Thread Tools | Display Modes |
|
#1
February 2nd 07, 03:03 PM
posted to rec.games.chess.computer
|
|||
|
|||
unix tool for removing duplicates from a large .pgn file?
Hi,
I'm collecting as much chess matches played (by humans) as possible. Now I have around 400MB of pgn-files and I would like to remove the inevitable duplicates. Does anyone know a tool for unix (linux/macos x/bsd/aix/etc.) doing so? -- -------------------------------------------------------------------- Phone: +31-6-41278122, PGP-key: 1F28D8AE, www.vanheusden.com 
|
| Ads |
|
#2
February 2nd 07, 06:49 PM
posted to rec.games.chess.computer
|
|||
|
|||
|
unix tool for removing duplicates from a large .pgn file?
Folkert van Heusden wrote:
Hi, I'm collecting as much chess matches played (by humans) as possible. Now I have around 400MB of pgn-files and I would like to remove the inevitable duplicates. Does anyone know a tool for unix (linux/macos x/bsd/aix/etc.) doing so? pgn-extract or scid -- GCP
|
|
#3
February 2nd 07, 09:26 PM
posted to rec.games.chess.computer
|
|||
|
|||
|
unix tool for removing duplicates from a large .pgn file?
Folkert van Heusden wrote:
Hi, I'm collecting as much chess matches played (by humans) as possible. Now I have around 400MB of pgn-files and I would like to remove the inevitable duplicates. Does anyone know a tool for unix (linux/macos x/bsd/aix/etc.) doing so? png-extract http://www.cs.kent.ac.uk/people/staff/djb/pgn-extract/ will do it for you. It has no GUI, will do what you want. ChessDB (based on Scid, but developed further), will do too. http://chessdb.sourceforge.net/ it has a GUI interface, so is quite different in use. Depends what you want. -- Dave (from the UK) Please note my email address changes periodically to avoid spam. It is always of the form: Hitting reply will work for a few months only - later set it manually. http://chessdb.sourceforge.net/ - a Free open-source Chess Database
|
|
#4
February 2nd 07, 10:42 PM
posted to rec.games.chess.computer
|
|||
|
|||
|
unix tool for removing duplicates from a large .pgn file?
Gian-Carlo/Dave: thanks! pgn-extract does exactly what I was looking for!
|
| Thread Tools | |
| Display Modes | |
|
|
Linear Mode
