Comments on: Delete Duplicate Rows From Database http://madhax.org/2010/01/delete-duplicate-rows-from-database/ code, caffeine and culture Sun, 16 May 2010 08:00:07 +0000 http://wordpress.org/?v=2.9.1 hourly 1 By: Madhax http://madhax.org/2010/01/delete-duplicate-rows-from-database/comment-page-1/#comment-1497 Madhax Sun, 16 May 2010 08:00:07 +0000 http://madhax.org/?p=108#comment-1497 Unfortunately I do not have a perl version of the above code. The code I put in my blog isn't very clear and looking at it now I got sort of confused as the pseudo code is more implicit than explicit. I have attached the full python code that I use in my production databases. It is in the form of a module. The only functionality you need to port this to perl is to be able to: -create hash tables -create queues -read/write binary files -perform SQL queries This code was meant for my eyes only, so I'm offering it as is and make no guarantees. I will answer questions when and if I have time. <a href='/wp-content/uploads/sqlremdup.py' rel="nofollow">CLICK HERE TO VIEW CODE</a> Unfortunately I do not have a perl version of the above code. The code I put in my blog isn’t very clear and looking at it now I got sort of confused as the pseudo code is more implicit than explicit. I have attached the full python code that I use in my production databases. It is in the form of a module.

The only functionality you need to port this to perl is to be able to:
-create hash tables
-create queues
-read/write binary files
-perform SQL queries

This code was meant for my eyes only, so I’m offering it as is and make no guarantees. I will answer questions when and if I have time.

CLICK HERE TO VIEW CODE

]]> By: MySQLer http://madhax.org/2010/01/delete-duplicate-rows-from-database/comment-page-1/#comment-1496 MySQLer Sun, 16 May 2010 07:16:22 +0000 http://madhax.org/?p=108#comment-1496 A production table I was working on had 16 million (with 8 million dupes) rows and I tried unique index method. It took around 6-7 hours. I'm trying algorithmic method (since I have to design a script for n other prod databases with same issue), if I am trying to develop similar function in perl as it would suit the requirement. Please let me know if you have a perl version of the above as I was not able to find some of the equivalent functions. A production table I was working on had 16 million (with 8 million dupes) rows and I tried unique index method. It took around 6-7 hours. I’m trying algorithmic method (since I have to design a script for n other prod databases with same issue), if I am trying to develop similar function in perl as it would suit the requirement. Please let me know if you have a perl version of the above as I was not able to find some of the equivalent functions.

]]>