Hey all,
I couldn't find an answer anywhere on the site, if there is one, could you please let me know where to go? Thanks.
Here goes. We receive large csv files, around a million records a month. What we need to do is:
- Of course, import these records
- Be able to run failry heavy reports on around 3 months worth of data (about 3 million records)
- Wanting to store at least a years worth of data
What I need to know:
- What server(s) spec (CPU, HDD, memory, etc) would we need to import and run reports quite fast. Don't want the reports/imports to take days to run. The reports will need to be run by about 3-5 people at the same time
- What OS and database type should I use (I was looking at Windows/Linux and MS SQL/MySQL)
- If we run these types of reports, can we use the same SQL server to run/store other applications (eg. CRM, etc) with no real impact on performance. There would be at least 20 people using the CRM database at the same time.
ThanksHowdy
You need a serious server - HP DL760 quad CPU 16GB RAM ( min ) 2 TB of storage ( or bigger) .
Windows 2003 and SQL 2000 Advanved Server. $$$$$$$
Any other OS's and servers will do same job,. Depends if you want windows or freeware...
Cheers,
SG|||Thanks for that SG. That is some serious power needed.
Just to understand how long it will take. I have a Compaq DL380 with 2GB RAM. Can you tell me more or less how long it will take to generate a report grouping a specific field and doing a total off another field, assuming it is based on the 3 million records?
Thanks|||Huh?
I don't claim to be a hardware expert, but SQL Server shouldn't even sneeze at 3 million records on a mid-range box.
2 TB storage? For 12 million records a year? Assuming about 500 bytes per record that is 180 years of storage.
16 GB or RAM seems like a steep requirement too, but RAM is never wasted on a server...
As far as how long it takes, my desktop SQL Server will churn through 3 million records in less than a second.
Any one else with opinions on this?|||SQL Server Express...
http://blogs.msdn.com/sqlexpress
Showing posts with label receive. Show all posts
Showing posts with label receive. Show all posts
Monday, March 12, 2012
Friday, February 24, 2012
Handling Error Messages
I am trying to run a command, say "logman start perfcollection" and the
error i receive is that the "Collection is already running"
I am running it as a SQL agent job and because the command is already
running, it fails with the error.
How can I check for that message and if its that message, than I want to
pass it as success condition.
ThanksHi Hassan
Try running the command through xp_cmdshell the return value should be
-1073738775 when the log is already running, alternatively you could always
stop it first before starting it as this will not cause an error.
John
"Hassan" wrote:
>
> I am trying to run a command, say "logman start perfcollection" and the
> error i receive is that the "Collection is already running"
> I am running it as a SQL agent job and because the command is already
> running, it fails with the error.
> How can I check for that message and if its that message, than I want to
> pass it as success condition.
> Thanks
>
>
>
error i receive is that the "Collection is already running"
I am running it as a SQL agent job and because the command is already
running, it fails with the error.
How can I check for that message and if its that message, than I want to
pass it as success condition.
ThanksHi Hassan
Try running the command through xp_cmdshell the return value should be
-1073738775 when the log is already running, alternatively you could always
stop it first before starting it as this will not cause an error.
John
"Hassan" wrote:
>
> I am trying to run a command, say "logman start perfcollection" and the
> error i receive is that the "Collection is already running"
> I am running it as a SQL agent job and because the command is already
> running, it fails with the error.
> How can I check for that message and if its that message, than I want to
> pass it as success condition.
> Thanks
>
>
>
Handling Error Messages
I am trying to run a command, say "logman start perfcollection" and the
error i receive is that the "Collection is already running"
I am running it as a SQL agent job and because the command is already
running, it fails with the error.
How can I check for that message and if its that message, than I want to
pass it as success condition.
Thanks
Hi Hassan
Try running the command through xp_cmdshell the return value should be
-1073738775 when the log is already running, alternatively you could always
stop it first before starting it as this will not cause an error.
John
"Hassan" wrote:
>
> I am trying to run a command, say "logman start perfcollection" and the
> error i receive is that the "Collection is already running"
> I am running it as a SQL agent job and because the command is already
> running, it fails with the error.
> How can I check for that message and if its that message, than I want to
> pass it as success condition.
> Thanks
>
>
>
error i receive is that the "Collection is already running"
I am running it as a SQL agent job and because the command is already
running, it fails with the error.
How can I check for that message and if its that message, than I want to
pass it as success condition.
Thanks
Hi Hassan
Try running the command through xp_cmdshell the return value should be
-1073738775 when the log is already running, alternatively you could always
stop it first before starting it as this will not cause an error.
John
"Hassan" wrote:
>
> I am trying to run a command, say "logman start perfcollection" and the
> error i receive is that the "Collection is already running"
> I am running it as a SQL agent job and because the command is already
> running, it fails with the error.
> How can I check for that message and if its that message, than I want to
> pass it as success condition.
> Thanks
>
>
>
Handling Error Messages
I am trying to run a command, say "logman start perfcollection" and the
error i receive is that the "Collection is already running"
I am running it as a SQL agent job and because the command is already
running, it fails with the error.
How can I check for that message and if its that message, than I want to
pass it as success condition.
ThanksHi Hassan
Try running the command through xp_cmdshell the return value should be
-1073738775 when the log is already running, alternatively you could always
stop it first before starting it as this will not cause an error.
John
"Hassan" wrote:
>
> I am trying to run a command, say "logman start perfcollection" and the
> error i receive is that the "Collection is already running"
> I am running it as a SQL agent job and because the command is already
> running, it fails with the error.
> How can I check for that message and if its that message, than I want to
> pass it as success condition.
> Thanks
>
>
>
error i receive is that the "Collection is already running"
I am running it as a SQL agent job and because the command is already
running, it fails with the error.
How can I check for that message and if its that message, than I want to
pass it as success condition.
ThanksHi Hassan
Try running the command through xp_cmdshell the return value should be
-1073738775 when the log is already running, alternatively you could always
stop it first before starting it as this will not cause an error.
John
"Hassan" wrote:
>
> I am trying to run a command, say "logman start perfcollection" and the
> error i receive is that the "Collection is already running"
> I am running it as a SQL agent job and because the command is already
> running, it fails with the error.
> How can I check for that message and if its that message, than I want to
> pass it as success condition.
> Thanks
>
>
>
Subscribe to:
Posts (Atom)