Is it possible to have two different database/dataset ?
Author: bobydesi123
Creation Date: 4/2/2010 4:34 PM
profile picture

bobydesi123

#1
Hi,
I have a PC with 80gb BOOT drive a high speed SSD(c:) and a 300gb HD(D:).
On my SSD, i have my OS, all my apps. and WLP and its data. I have about 16gb reserved for "Virtual Memory".
I have LOTs of 1min/5min data that is taking up space on SSD. My SSD is almost full.
Q: Can i relocate ONLY all my intra-day (1min/5min) data to D: and leave the rest of the data on C: for performance?
How can I do it? Thank you.
profile picture

Eugene

#2
With standard and supported methods, you can relocate the entire Fidelity data collection using Data Manager. See the User Guide on how to do it.

As an unsupported workaround, here's how to trick Windows into thinking that a folder on D: "is" a folder on C:

data folder location
profile picture

Eugene

#3
On the other hand, maybe you should first try reducing the space reserved for virtual memory, cleaning up some extra system files, turning off some Windows features etc.
profile picture

bobydesi123

#4
Eugene,
Thxs.
As an unsupported workaround, here's how to trick Windows into thinking that a folder on D: "is" a folder on C:
"data folder location" ==> does not work, it just takes me to the main Wealt-Lab page.

profile picture

Eugene

#5
I verified it as an unlogged (guest) user and it does work. Browser problems, improper URI copy/paste etc. - double check everything. Or search the forum for a post titled: "data folder location".
profile picture

bobydesi123

#6
Eugene,
I was able to relocate my Fidelity data from fast SSD to the large but comparetively slower D: drive.
Am I correct to assume following as far as performance is concerned, specially for RT streaming?
- WLP after initially executing the strategy on symbols of interest, it will use D: to backfill the intra-day data.
-After that all data/indicators is cached first in RAM and if required in Virtual Memomy (which is on FAST SSD).
-So except for initial backfill from D:, my performance in RT streaming will most likely be same as when I had all data (daily, 1min..etc) on SSD.
Thxs for ur help.
profile picture

Eugene

#7
Most likely, yes.
profile picture

bobydesi123

#8
Eugene,
As i had mentioned in my earlier post, i was able to move FidelityStatic data folder to the larger D: drive to free up my c: drive (SSD). After doing this, i tried to delete the intra-day data from the SSD by first deleting the 1min and 5min data sets, which took up most of the space on my c:, about 16gb. Deleting the intra-day datasets just deletes the .XML files and all of the actual intra-day data is still on SSD.
Here are my questions:
1. Is there a WLP controlled way of deleting the actual data or do i have to manually delete the 1min and 5min folders?
-If I manually delete these folders will WLP be unstable? As i am doing it without the WLP being aware of it.
2. Next question is, on my SSD i would like to retain 1min and 5min data for some stocks that I frequently trade, e.g. All the stock for NASDAQ100 and S&P500. If i delete the intra-day datasets as in Q 1.) above... i guess i will have to recreate the 1min and 5min datasets for nasdaq100 and s&P 500 on SSD and download them again from the fidelity server, correct? Or is there another way? As downloading fresh 1min data seem to take forever.
Thxs in advance.
profile picture

Eugene

#9
Moving the Fidelity data is called relocation, which is a standard option in the Data Manager. One doesn't need no other manipulations to move the FidelityStatic folder (only). It's documented in the User Guide.

1 - Re: deleting the *.WL files, not XML - yes, it's possible by deleting the symbols from all DataSets and updating Fidelity data with "Delete data for symbols not contained in DataSets" enabled.

WLP won't get unstable, it just resets the data files so they will be downloaded from scratch.

Have you copied the 16Gb data to D: - vs. moved? If yes, point WLP5 to the new location (User Guide) and remove the old data folders on C:.

2 - When WLP sees no data file, it will download the data. If you have the data, no need to download it again. Might be possible if you use symlinks to store some data on C: and some on D: (see link above). As you understand, I haven't tested it and this workaround is unsupported.
profile picture

bobydesi123

#10
Eugene,
As always thxs for ur quick response.
1. I had copied the Static data folderfrom c: to D:, I tried relocating using the WLP but for some reason it seem to take a long time. Copying forlder manually rakes only a few minute. However, i did pont my folder to D: in WLP and seem to work fine.
-The question i was asking was if i deleted ALL intra-day folders from c: to reclaim space, then i will have to reload for the inta-day data( 1min, 5min) for s&p500 and NDX100 on c:, i want to keep c:SSD as my primary drive because it is very fast.
- If i understood u correctly..." Might be possible if you use symlinks to store some data on C: and some on D: (see link above). As you understand, I haven't tested it and this workaround is unsupported." ...this is ur suggestion for me to avoid re-downloading the intra-day data on c:.
I am sorry, i lost u on the high-lighted part, did u forget to post the link?
profile picture

Eugene

#11
QUOTE:
-The question i was asking was if i deleted ALL intra-day folders from c: to reclaim space, then i will have to reload for the inta-day data( 1min, 5min) for s&p500 and NDX100 on c:, i want to keep c:SSD as my primary drive because it is very fast.

1. Move the complete set of Fidelity data to D: manually (i.e. the Fidelity* folders). Don't leave the intraday data.
2. Perform data relocation (there should be nothing bulky to move as you've already done it)
It's your files, your disk - I can't see it.
QUOTE:
I am sorry, i lost u on the high-lighted part, did u forget to post the link?

No, the method is the same I've been pointing you before: see my reply dated 4/3/2010 1:20 AM.
profile picture

bobydesi123

#12
Eugene,
No, the method is the same I've been pointing you before: see my reply dated 4/3/2010 1:20 AM.
Oh, ok i got that, i thought u were taking about something else, Anyways, problem solved! Thxs for ur help.
P.S. when is fidelity going to fix their RT server? I dont seem to be able to get reliable RT feed for any stocks (regardless of i have intra-day static data on my HD, enable/disable data on demand etc.) but indexes. Sometime they work all day sometimes they dont.
This website uses cookies to improve your experience. We'll assume you're ok with that, but you can opt-out if you wish (Read more).