03-30-2012 08:15 AM
I have been using the Importing Data from Multiple DataPlugin Files programm and first i should say THANKS !!!!!
Now my question:
- When the porgram is using a dataplugin and open, process and concatenate the data, what it do first ? bring the data already proccessed by the dataplugin and later concatenate it or bring all, concatenate it and later proccess ?
Why i ask :
- I have Mutiple CSV files with the same header line inside (different data of course) and the file name say from where come MST1, MST2...
- the file name have to the day of the data.
- I created a Dataplugin to filter and order (rename channels, etc) my data... and all works fine when i use to open multiple files...
- When i used it with concatenate data is doing really well just when i use data from the same MST1... the result is the concatenated data of the days...
- When i try it with more files MST1 and MST2, all the info is concatenated (repeated) in one group.
- Diadem 10.2 and xchannel is the time.
- the programm just order in one group, so, what i want is not possible. ??
- load the data in order and later concatenate it, but how i use the concatenate group "alone" to take from the dataportal ?
- no more ideas for that i'm writing in the forum...
Any idea ?
Thanks in advance
07-02-2012 08:30 AM
Let me see if I've understood it.
Are MST1, MST2 ... the name of your files?
Do the problem happen just when you try to open MST1, MST2... files at the same time?
Can you send me your CSV files and your Datapluggin? Thus I can try to reproduce your error.
07-03-2012 08:35 AM
The original script dates back before DIAdem had multiple groups, but I think there is already a mechanism in the current version of the application that you can use to accomplish what you want, albeit in several steps. I'm going to suggest that you run the script once for each group in your data files. You can tweak the script to do this automatically for each group in the first file, but for now just try it manually by changing the following line 10 in the script:
ChannelSet = "/*"
This will restrict the channels loaded to those in group=2. You can run this script once with "/*" for group=1 and then a second time with "/*" for group=2, etc. If that works, then you can add on automatic saving of the concatenated data to a TDM file. You could also add looping with error checking on to keep tring "[i]/*" until "i" gets bigger than the number of groups in the file. You could also then load back in all the TDM files you had saved, one for each group, to see the full multi-group concatenated results.
Unfortunately I'm going to be unavailable to help with this for the next 3 weeks, but I will return and could help then.
DIAdem Product Support Engineer
07-03-2012 10:42 AM