Slow Import Speed

General discussion of PokerTracker 3.

Moderator: Moderators

Re: Slow Import Speed

Postby kraada » Tue Jul 17, 2012 8:47 am

Going from hand history text size is difficult to do because some hands take longer and some hands do not . . . I don't have a good average amount of text per hand size rule of thumb at the moment. But I'd expect it to be a considerable amount of hands yes.
kraada
Moderator
 
Posts: 54431
Joined: Wed Mar 05, 2008 2:32 am
Location: NY

Re: Slow Import Speed

Postby pat3392 » Mon Jul 30, 2012 12:07 am

I'm not going to have enough hard-drive space; is there anyway I can make the storage scalable? That is, able to add more as I go on? And can I run the database off a external hard-drive without losing processing power?
pat3392
 
Posts: 142
Joined: Wed Jan 27, 2010 7:44 pm

Re: Slow Import Speed

Postby pat3392 » Mon Jul 30, 2012 12:10 am

Is there also a way that I can add multiple computers to my main system to increase processing power? Or just anything in general I can do to create a hardcore poker system that's capable of running a database of like 40 million hands?
pat3392
 
Posts: 142
Joined: Wed Jan 27, 2010 7:44 pm

Re: Slow Import Speed

Postby WhiteRider » Mon Jul 30, 2012 3:33 am

You can certainly run PostgreSQL or host the database files on a separate computer - check out the guides in the documentation.
WhiteRider
Moderator
 
Posts: 53961
Joined: Sat Jan 19, 2008 7:06 pm
Location: UK

Re: Slow Import Speed

Postby pat3392 » Thu Aug 09, 2012 12:03 am

I went to purchase a dedicated hard-drive for my database; I wanted to get about 3TB of SDD, but I was told this sized drive doesn't exist in SDD form. If I want to use SDD for my database, I'm going to have to use a RAID 50, with 3 "mechanics" and 2 of something else, may have been called a platform, and I think the 2 are responsible for caching, and the other 3 are my actual hard-drive space, or something, I'm really not sure and have to look into this more. It's fairly expensive too, but anyway, do youse have any opinions on this? I'd like to have it scalable, if possible, as I don't think 3TB will be large enough, as I plan to have a LOT of hands.
pat3392
 
Posts: 142
Joined: Wed Jan 27, 2010 7:44 pm

Re: Slow Import Speed

Postby pat3392 » Thu Aug 09, 2012 3:03 am

Can I merge two computers together to enhance database processing speed? Where is the bottleneck in regards to Poker Tracker's slow speed?
pat3392
 
Posts: 142
Joined: Wed Jan 27, 2010 7:44 pm

Re: Slow Import Speed

Postby pat3392 » Thu Aug 09, 2012 3:12 am

And if 1TB=100 million hands, that means 1hand=1MB, right? That seems incredibly large.
pat3392
 
Posts: 142
Joined: Wed Jan 27, 2010 7:44 pm

Re: Slow Import Speed

Postby WhiteRider » Thu Aug 09, 2012 3:45 am

The rule of thumb for PT3 is 1G = 100k hands (for full ring - if it's 6max it's 2/3 that amount). You could configure a separate computer to run the PostgreSQL server, but I'm not sure whether it is possible to split a database across multiple computers. However, if you're going to import that many hands you may find it better to split the hands across several databases, and it would be possible to split those across different drives. Kraada may have more specific advice when he comes on later.
WhiteRider
Moderator
 
Posts: 53961
Joined: Sat Jan 19, 2008 7:06 pm
Location: UK

Re: Slow Import Speed

Postby pat3392 » Thu Aug 09, 2012 4:05 am

What about the SDD hard-drive, is that neccesary to be able to actually use my database without epic lag?
pat3392
 
Posts: 142
Joined: Wed Jan 27, 2010 7:44 pm

Re: Slow Import Speed

Postby kraada » Thu Aug 09, 2012 7:49 am

It shouldn't be necessary but it will help improve responsiveness as your databases get larger. The most resource intensive thing that PokerTracker does is pull large amounts of data from whatever disk drive you have - having a faster random read time (which SSDs do) will make a noticeable difference.
kraada
Moderator
 
Posts: 54431
Joined: Wed Mar 05, 2008 2:32 am
Location: NY

PreviousNext

Return to General [Read Only]

Who is online

Users browsing this forum: No registered users and 16 guests

cron
highfalutin