5ubliminal@twitter

Pushing an Intel Quad-Core QX6700 Over 50% (percent) : 5ubliminal's TellinYa

<a href="http://www.tellinya.com/art2/156/">Pushing an Intel Quad-Core QX6700 Over 50% (percent) : 5ubliminal's TellinYa</a>
5ubliminal's YAMS


Intel Core 2 Extreme Quad-Core
2.66 GHz QX6700 Processor

I did it …

I achieved the unachievable. I went over 50% in CPU usage with a software I coded with intense multithreading and text indexing. I kept a steady 15-30 seconds over 25% with peaks over 50% during a certain section of my software but I'm proud to have achieved this on a Gaming Beast that plays 3D first person shooter games with 0-2% CPU usage.

I'm happy to have done this because the software that broke the barrier was mine. It's a really demanding piece of console application that does a lot. I'll detail you below what it does. If you are interested in buying such a CPU read the Intel Quad-Core - Overkill or Not? article I published.

Want visual confirmation?

As you may see in the screenshot the CPU usage is 40% of which 37-38% is consumed by my software. It even reach a peak of 53% and that left me speechless knowing how hard it is to get it over 10%. Many of you might be curious what that software does in order to use that kind of Quad-Core CPU power?

The software that made it

It's fully coded in Visual C++ (SDK - MFC Free). It downloads content from 1000 relevant pages (25 done simultaneously), then strips HTML code (heavy RegExp from over 25MB of HTML code), indexes content, compresses data (gzip), gets relevant keyphrases, gets images from flickr and other sources, finds sentences, uses a basic Markov and some LSI on those sentences to … We stop here! Those that know … know, those that don't … don't need to know!

PS: Some source code is visible on the background ;) and this article is somehow related to this other one about porting code from PHP to C++!

3 Comments Posted By Readers :

Add your comment
#1 David Hopkins from Great Britain web
Posted on Thursday, 20 September, 2007
Sounds like a inovate script you have there and I thought my 50MB file parsing was heavy :P

What is the purpose of this data you are collection though?
#2 5ubliminal web
Posted on Thursday, 20 September, 2007
I parse 25-30MB files. About 100+ in a row. It runs for a few hours when needed.
Purpose? :) (HRCG) Human (Search Engine) Readable Content Generation!
It 'learns' the text. Rudimentary, but it 'kind of' works. Fun to read!

PS: Do not offend my compiled software. It's not a script :) C++ is not Script.
#3 FMN Media from Great Britain web
Posted on Tuesday, 28 October, 2008
Try folding...
Post Feedback 
Name *
Mail *
URL
« Anti-Spam
» URL will only go live after a review. Comments are moderated. «
5ubliminal's TellinYa.com SEM & SEO Blog © 2007 - All rights reserved unless mentioned otherwise .
Rendered On : [Friday, 21 November, 2008 - 08:44:11 GMT]   No Ajax / Flash Used Here
" Pushing an Intel Quad-Core QX6700 Over 50% (percent) : 5ubliminal's TellinYa "