29 January 2018, 22:57 | #1 |
Registered User
Join Date: Jan 2017
Location: Antwerp / Belgium
Posts: 189
|
new online TOSEC tool
Hey,
I've been busy the past week helping with the imaging of the Bamiga Sector One Collection from physical disks to ADF. Doing that I had to dig around to find the correct TOSEC tools and .dat files to check if the disks where already known or not. Installing all this is fine if you really are into collecting, but I missed a quick and easy way to quickly check a few disks. So I made one - all in the bowser, no installing needed: http://www.amigaclub.be/tosec/ I have a question though: Currently only the md5 hash of the disk is checked. In the BS1 collection, this results in HEAPS of disks not already in TOSEC, while in most cases it's just a slight variation of a disk that is already present. Is there a way to quickly identify these "alt" versions? Maybe by comparing file hashes or track/sector hashes? Are there any existing databases for this or should I just create one myself? Ideally I would like the tool to return stuff like "This disk matches xxxx.yyyy.adf for 95% so it's probably this disk" instead of only the black&white match/no match. That way you can actually see if you have found something rare or not. |
29 January 2018, 23:04 | #2 | |
Banned
Join Date: Aug 2005
Location: London / Sydney
Age: 47
Posts: 20,420
|
Quote:
In the past I've provide "combined" TOSEC .DATs to assist people but I'm no coder and alas these still need to be run the old fashioned way; via ClrMAMEPro: Amiga - Latest Public DATS Combined (TOSEC-v2007-03-14) & (TOSEC-v2017-04-23) |
|
29 January 2018, 23:30 | #3 |
Registered User
Join Date: Feb 2012
Location: #DrainTheSwamp
Posts: 4,545
|
nice tool
#1) ADF workshop is able to identify similiar disks, it lists the correct tosec diskname, or lists disks close to it sorted by percentages. |
30 January 2018, 00:31 | #4 | |
Global Moderator
Join Date: Nov 2001
Location: Derby, UK
Age: 48
Posts: 9,355
|
Quote:
I guess it wouldn't be that difficult to code something that does a byte comparison on the adf and let's you know the difference %, num bytes different etc... Worth pondering I suppose Edit in fact yes I do remember see the screenshot Last edited by BippyM; 30 January 2018 at 00:37. |
|
30 January 2018, 06:47 | #5 |
Registered User
Join Date: Oct 2012
Location: Italy
Age: 49
Posts: 2,945
|
How TOSEC team choose amongst the various slight variations of a disk ?
In other words, when a disk tagged with [a] is inserted in the archive ? |
30 January 2018, 10:53 | #6 | |
Registered User
Join Date: Jan 2017
Location: Antwerp / Belgium
Posts: 189
|
Quote:
Do you mean there are fingerprints other then the usual CRC/MD5/SH1 in those .db files? Or does it do a binary compare on 2 adfs ? I guess I should ask Crashdisk about this. |
|
30 January 2018, 10:58 | #7 | |
Registered User
Join Date: Jan 2017
Location: Antwerp / Belgium
Posts: 189
|
Quote:
I would like to avoid a full binary compare though, as then the entire ADF would have to be transfered to/from the server. And even then: I you do a disksalv or disk optimisation on a DOS disk, it still would be the same disk but it would be binary totally different. A "simple" file list compare or a track hash compare would be much faster, but setting up these kinds of fingerprint databases for 80.000 disks would be a little out of scope for this project for now. I guess I'll have to bug the guys on the TosecDev forums for this kind of data. |
|
30 January 2018, 16:04 | #8 | |||
Registered User
Join Date: Feb 2008
Location: Federativnaya Respublika Germaniya
Posts: 4,994
|
Quote:
Quote:
Quote:
Isnt this, what you are looking for? BTW: To be up to date you have to download database of current TOSEC release! ----- Anyway, nice online tool for quick and easy checking ADFs. Last edited by mai; 30 January 2018 at 16:26. |
|||
30 January 2018, 16:33 | #9 |
Registered User
Join Date: Jan 2017
Location: Antwerp / Belgium
Posts: 189
|
|
30 January 2018, 16:58 | #10 |
Registered User
Join Date: Feb 2008
Location: Federativnaya Respublika Germaniya
Posts: 4,994
|
Database of current TOSEC release is here:
http://eab.abime.net/showthread.php?t=64668 TOSEC-v2017-11-01.db |
31 January 2018, 19:42 | #11 |
Registered User
Join Date: Oct 2012
Location: Italy
Age: 49
Posts: 2,945
|
Your TOSEC tool is nice, but can i suggest you one thing ?
At the moment your tool miss the support for .dms files This kind of disks are so common that i guess they should be supported by your tool Anyway, no idea of the effort needed for such kind of improvement Last edited by chip; 31 January 2018 at 19:49. |
31 January 2018, 19:46 | #12 |
Banned
Join Date: Aug 2005
Location: London / Sydney
Age: 47
Posts: 20,420
|
BS1 Collection - awesome looking haul of disks is the wrong thread for this discussion chip.
Moved accordingly |
01 February 2018, 04:55 | #13 | |
Registered User
Join Date: Jan 2017
Location: Antwerp / Belgium
Posts: 189
|
Quote:
One step at a time :-) It will never be a batch converter though, there are other/better options for that. Dropping 200 .dms files in one go would probably kill your browser. |
|
01 February 2018, 05:48 | #14 |
Registered User
Join Date: Oct 2012
Location: Italy
Age: 49
Posts: 2,945
|
Sure Steffest, one step at a time
And since we are talking of this, do you have intention to create also a standalone application for such kind of TOSEC check ? |
01 February 2018, 11:09 | #15 | |
Banned
Join Date: Aug 2005
Location: London / Sydney
Age: 47
Posts: 20,420
|
Quote:
Again, see these threads: ... ADFs - renaming / comparing / finding out if you have anything rare!!! ... Amiga - Latest Public DATS Combined (TOSEC-v2007-03-14) & (TOSEC-v2017-04-23) |
|
01 February 2018, 11:24 | #16 |
Registered User
Join Date: Oct 2012
Location: Italy
Age: 49
Posts: 2,945
|
No, i'm not going to check thousands and thousands of files, it's not that my intention
I only guessed that such kind of operation (checking few disks against TOSEC) could be done also with a standalone application I'm still not able to use ADF-Workshop to do that, even if i know there's a way to do it ..... my fault |
07 February 2018, 17:18 | #17 |
Registered User
Join Date: Feb 2008
Location: Federativnaya Respublika Germaniya
Posts: 4,994
|
|
27 June 2018, 14:11 | #18 | |
Pastafarian
Join Date: Sep 2010
Location: Uppsala/Sweden
Posts: 290
|
Quote:
Handy tool, but at the moment it just stops at "checking tosec". I tried latest chrome and firefox and with a few different adf-files. |
|
28 June 2018, 08:18 | #19 |
Registered User
Join Date: Jan 2017
Location: Antwerp / Belgium
Posts: 189
|
|
29 November 2018, 04:56 | #20 | |
Unregistered User
Join Date: Sep 2012
Location: Copenhagen / DK
Age: 43
Posts: 4,190
|
Quote:
One problem for me is that many of these disks that I dumped had been copied using something like Bamcopy so unused sectors were left untouched thus invalidating the checksum.. I know that this has nothing to do with your tool, but it does mean a lot of extra work to verify the disks against the versions in TOSEC. |
|
Currently Active Users Viewing This Thread: 1 (0 members and 1 guests) | |
Thread Tools | |
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Online "retro" image tool | AnimaInCorpore | Coders. General | 85 | 08 September 2022 21:09 |
Amiga - Latest Public DATS Combined (v2020-10-31) & (v2019-05-10) & (v2018-07-27) | DamienD | project.TOSEC (amiga only) | 27 | 28 December 2020 13:51 |
HEAVY BBS now online [Telnet] Over 700 ADF files online | Dougal | Retrogaming General Discussion | 4 | 05 July 2016 01:53 |
TOSEC - DAT Pack - Complete (1111) (TOSEC-v2009-12-27) | Aral | project.TOSEC (amiga only) | 8 | 30 January 2010 11:14 |
PD Tosec online! (come and download folks!) | Ironclaw | News | 27 | 03 October 2007 21:34 |
|
|