In which database type i should store large amount of data?

[Nishant]

Hiii, All

           I am using DAQ cards to fetch the data from 32-Analog channels and 16-digital channel and after that, i am storing those datas into .xls file(Tab delimited file), but i was creating new file, whenever it fills with the 60,000 rows, and i was creating a new file with the index name is next file number related to the previous file, but the problem is customer wants that, all the data should be stored in the single file and the possibilities that rows can be increased more than 65,535 and file can be overlapped and customer cannot see the dat, so can anybody tell me that which database instead of excel i can use so that, it can be stored in the singole file, instead of creating more files for more datas, actually it is a trigger, whenever trigger comes, data writing in the file started and when trigger ends, file writing ends and the main thing is for one trigger there must be a single file, please suggest me something.

Thanks in Advance,

Nishant

[Dennis_Knutson]

I'm not a big fan of Access but it's somewhat cheap and is often included with people's Office installation. For real, robust, industrial strength db's look at SQL Server, Oracle, or MySQL (free). My IS department supports SQL Server so that's what I use but I've played a little with MySQL and liked what I saw. As long as there is an ODBC driver available for the database, you can use it with the toolkits available for LabVIEW.

[unclebump]

You could use the Citadel database if you have the DSC tag engine, or possibly look into using NI Diadem.

[Nishant]

Hiii, Dennis and IUnclebump

         Thanks for the reply, actually as i explained to you, the data could go to the higher ranges, so that i want to be causious, actually i have used the Access and SQL both, but i am not sure, how much maximum of data they can store in one table? because the condition is once the trigger starts, it starts to store the data and it will only stop adding the data, while trigger stops, now there is no defined time for the trigger, thats why i am worrying.

                   Hey Unclebump, can you please give me links to the basics of the citadel, i have heard about it but i am not aware of it.

Thanks,

Nishant

[unclebump]

Here you go.

https://www.ni.com/docs/en-US/bundle/labview-datalogging-and-supervisory-control-module/page/lvdscco...

https://www.ni.com/en/support/documentation/supplemental/06/archiving-options-for-citadel-historical...

https://www.ni.com/docs/en-US/bundle/labview-datalogging-and-supervisory-control-module/page/lvdsche...

https://www.ni.com/en/shop/data-acquisition-and-control/application-software-for-data-acquisition-an...

[DFGray]

NI-HWS was designed for this sort of application.  NI-HWS uses HDF5 under the hood, so any program which can read HDF5 can read the HWS files.  HWS supports multiple waveforms per file and has compression options.  File size is limited by your available disk size.  You will need to use the low level interface to write multiple waveforms per file.  Make sure you give each waveform a unique name.

HDF5 itself will also easily handle this problem, but the learning curve is pretty steep (which is why HWS was created).  

You can find NI-HWS on your driver CD under the computer based instruments tag.

[Dennis_Knutson]

Database storage (at least for real ones like SQLServer, Oracle, MySQL), is only limited by how much disk space you have. If you want to create a TeraByte disk array, you can do that.

[Nishant]

Hiii, Dennis

                 Thanks for such a good information, that mean i can use these databases for my use, but the thing is i9 have to purchase the toolkit for the database support, isn't it? Ok, that is what i am lookin for, thanks anyways.

    Hey DF gray thanks for the information, that is what we are exactly doing , we are storing the datas which are coming from the external input, and then after want to see the historical trend of the stored datas, so that these can be useful.

Thanks,

Nishant

[Enrique]

I am using PostgreSQL. My opinion is that it is fantastic. It was easy to integrate with both the DB toolkit and LabSQL.

[Nishant]

Hiii, Enrique

            Thanks for the reply forst of all, Thanks for the links, actually i have got something from the LabSQL, because it is not possible for us to purchase a DB toolkit at this time, so i was looking for the chipper solution, but i have got the free solution, and thats what encourage me to work, now i will use it directly with LabVIEW which can help me better way, and most probably i will use SQL instead of MS Access, so it could be more powerful, anways thanks for the input.

                Another thing is i couldnt find anything from the PstgreSQL, i am trying to download it, but i couldnt  understand how to dload it actually, because there are so many directories given on the download page, and i am confused about how to download it?

Thanks,

Nishant