Output to text files or a database?



I was reading The Art of Unix Programming yesterday, and was inspired
to rework and split up an large monolithic application of mine.

This software has to do with the retrieval and processing of travel
information (flights, hotels, etc) from different sources. Each source
has travel data formatted differently.

With plain text files being the universally loved file format, I
planned on writing small apps that would pull down data from these
different sources, and write them to text files in a universal format.

Another small app would read these text files, generate sql insert
statements from the data, and dump all the data into a relational
database.

I proposed this to a coworker, and he asked why the text files were
even necessary -- why not just immediately generate sql statements from
the different formats, and use the tables in the DB as the universal
format? Textual representations of that data could just be generated
from the database, after all.

Is he right? Is there any reason to use text files as an intermediate
format? My gut is telling me to keep them, but my gut isn't good at
convincing people. :) What am I missing?

.



Relevant Pages

  • Re: Protel 2004 answer to Brad Velander.
    ... Sorry, you misunderstand me, I mean to say that jump from 99SE to 2004 XP ... you don't have the same format with one database will all the documents. ... Well you said that you can export file format more recent than AUTOCAD 14 ... key/mouse click you press because I don't know how to do that with Protel ...
    (sci.electronics.cad)
  • Re: Combo box not finding record... sometimes
    ... Try the Format option last. ... Private Sub cboLnNum_AfterUpdate ... when I change the data type from Double to Long Integer the database ...
    (microsoft.public.access.formscoding)
  • Re: Error Message: Cant find Installable ISAM
    ... The database is residing on my machine, ... Error Message = "Couldn't find Installable ISAM" ... Connect property set = Access ... Access 2002/2003 format and tried this as a possibility, ...
    (microsoft.public.vb.database)
  • Re: What program is best for large inventory?
    ... put the information in the format that I want. ... down into several sub groups and some even further. ... The learning curve for general database concepts is moderate. ...
    (microsoft.public.office.misc)
  • Re: Acc97 Recordsets vs Acc2000/2002
    ... Microsoft DAO 3.6 Library ... Uncheck everything else except the 2 required libraries. ... Access 2002 can save the database back to A97 format if needed. ...
    (microsoft.public.access.modulesdaovba)