Browse > Home / Archive by category 'Software Development'

Reading CSV File Using C Program

June 2, 2008

Since I'm on an integration project, I'm mostly dealing with transferring of data from two or more systems whether it's from the legacy system or newly implemented system. Most of the type of data movement is sending CSV files to and from the different system. Here is a simple tutorial on how to read CSV. The CSV file contains the following:

PLAIN TEXT
CODE:
  1. 1111,1414,1000
  2. 1112,1010, 1001
  3. 1113,1112,1002

The fields are Item Number, Class Number and Supplier Number.

The example below is the simple code of reading CSV file in C.

PLAIN TEXT
CODE:
  1. #include <stdio.h>
  2. #include <stdlib.h>
  3. #include <string.h>
  4.  
  5. int main(int argc, char* argv[])
  6. {
  7.    if (argc <2)
  8.    {
  9.       fprintf(stderr,"Usage: %s csv_file\n",argv[0]);
  10.       return(1);
  11.    }
  12.  
  13.     FILE *f = fopen(argv[1], "rt");
  14.     char Line[256];
  15.     unsigned int AllocSize = 0, Size = 0, n;
  16.     char *L_text;
  17.  
  18.     while(fgets(Line, sizeof(Line), f))
  19.     {
  20.  
  21.       printf("Item = %s \n",strtok(Line, ", "));
  22.       printf("Class = %s \n",strtok(NULL, ", "));
  23.       printf("Supplier = %s \n",strtok(NULL, ", "));
  24.  
  25.     }
  26.    return(0);
  27. }

Filed Under C, Integration · Leave a Comment  

Determine the File Count in Unix Directory

May 21, 2008

To determine the number of files in the Unix directory, use the following command.

PLAIN TEXT
CODE:
  1. ls -l | grep -c "^-.*"

Filed Under Unix · Leave a Comment  

Merging Files in Unix

May 9, 2008

You have multiple files in containing data in similar format and wanted to consolidate in a single file. This is usually the case if you have a daily log that you want to place an archive copy in a single file in weekly or in monthly, yearly.

The basic syntax of merging file is

PLAIN TEXT
CODE:
  1. cat <source file> >>  <target file>

If you have more than 10 files to merge it is better to write a shell script that will loop through the files and merge in a file. The following is the code for merging the files in a folder into a single file.

PLAIN TEXT
CODE:
  1. #!/bin/sh
  2. echo enter file name
  3. read filename
  4.  
  5. for arg in `ls;`
  6.    do
  7.    echo $arg
  8.    cat $arg >> $filename
  9. done

Lines 2 and 3 prompts the user for the filename of the file which will contain the consolidated contents of all the files in the current folder.

Lines 5 to 9 loops through the files in the current folder and merge the files to a single file.

Simplest File Merging

PLAIN TEXT
CODE:
  1. #!/bin/sh
  2. echo enter file name
  3. read source_filemask
  4. read master_filename
  5.  
  6. cat $arg >> $filename

A simple file merging

PLAIN TEXT
CODE:
  1. cat $<filemask>*> $<filename>

Example

PLAIN TEXT
CODE:
  1. cat $Test*> $FinalTest.txt

Filed Under Unix · Leave a Comment  

Writing Files in Unix

May 9, 2008

To write files in Unix, the syntax is

PLAIN TEXT
CODE:
  1. echo <text> > <filename>

Example

PLAIN TEXT
CODE:
  1. echo "This is my message." > myfile.txt

To add another line in the myfile.txt, use the following syntax.

PLAIN TEXT
CODE:
  1. echo "This is my second message." >>  myfile.txt

You may notice that double greater than sign (>>) is used instead of single greater than sign. This means that the message is written in append mode.

Let's open the myfile.txt by using the following command.

PLAIN TEXT
CODE:
  1. tail  myfile.txt

The content of the myfile.txt should have the following.

PLAIN TEXT
CODE:
  1. This is my message.
  2. This is my second message.

Filed Under Unix · Leave a Comment  

How to display newline in Excel?

January 12, 2008

The commonly used to display newline in Visual Basic is using VbCrLF. But the problem is you will see a small rectangle at the end of the line.

Excel New Line

PLAIN TEXT
Visual Basic:
  1. Dim strFirstLine As String
  2. Dim strSecondLine As String
  3.  
  4. strFirstLine = "This is the first line"
  5. strSecondLine = "This is second line"
  6.  
  7. Worksheets("Sheet1").Range("b4").Value = _
  8. strFirstLine & vbCrLf & strSecondLine

To solve this problem, you will need to change the code from VbCrLF to VbLf.

PLAIN TEXT
Visual Basic:
  1. Dim strFirstLine As String
  2. Dim strSecondLine As String
  3.  
  4. strFirstLine = "This is the first line"
  5. strSecondLine = "This is second line"
  6.  
  7. Worksheets("Sheet1").Range("b4").Value = _
  8. strFirstLine & vbLf & strSecondLine

Excel New Line

Filed Under VBA · Leave a Comment  

Things to Do

November 18, 2007

  1. Tutorials on the following:
    1. SQL
    2. PL/SQL
    3. Oracle Forms
    4. Unix
    5. C
    6. Java
    7. J2EE
    8. SOA
    9. Oracle SOA Suites
  2. Create a personal blog.
  3. Update SOA Enterprise
  4. Review for PL/SQL exam
  5. Review for Oracle Forms Exam
  6. Study IBM SOA
  7. Study UML and Object Oriented Design
  8. Study SCEA
  9. Study Oracle SOA

Filed Under Projects, Technical Architecture · Leave a Comment  

Pro *C Programming Do’s and Don’t

November 18, 2007

  1. Use one array per action such as inserting, updated and deleting records.
  2. Always increment the array counter every time you add new records.
  3. Always resize array every time you add new records.
  4. Always reset the array counter after the bulk update, insert and delete.
  5. Inserting or updating records should comes last if the value of column in comes from a separate logic such as calculation, sequence retrieval.

Filed Under Programming · Leave a Comment  

Time to Upgrade Your Skills Towards SOA

November 12, 2007

SOA is still not mature enough but it's evolving fast as the software vendors continues to innovate and improve their SOA products and strategies. According to experts, SOA will be mature in 6 years so it's time for the techies to upgrade their skills and move towards SOA skills such as Java, .NET,  SOA suite.

Filed Under SOA · Leave a Comment  

Software Best Practices Conference

September 23, 2007

I want to share ideas from Youdon. His presentation for Software Best Practices Conference is about Ten Most Important Ideas in Software Engineering.  Here is what he talks about:

  1. You can't control what you can't measure
  2. Peopleware
  3. Incrementalism
  4. Iteration
  5. Repair costs increase
  6. Tradeoffs are non-linear
  7. Reuse is important
  8. Risk management provides insights
  9. Consistency trumps brillance + death march
  10. Don't reinvent the wheel

You can download the pdf here.

Filed Under Programming · Leave a Comment  

Becoming a Technical Architect

September 11, 2007

After my long vacation, doing something different from my work as an Oracle Retail specialist, I realized that I have a brand new dream. In the past, I'm eager to accelerate my career level progression. I want to move up to a higher position as soon as possible but due to the undesired and unexpected turns of time, this is not a feasible as before.

I'm goal now is to further improve my technical skills and be certified. I started to review for Oracle Certification. I reviewed for 3 months for my examination in 1Z0-007 Introduction to SQL and passed with 90.4%. Now I'm now preparing for Oracle Database SQL Expert Exam which is scheduled on Sept 13, 2007. This is a beta exam which I need to wait for 10 weeks to know the results. After this I'll prepare for PL/SQL exam.

Right now I'm thinking to proceed with certification as an Architect by taking examinations for Sun Certified Enterprise Architect (SCEA). I'm a member of PinoyJUG(Pinoy Java Users Group) and a couple of members are interested taking this specially Sun is offering free examination for this beta examination.

The following are useful links for this certification.

Filed Under Technical Architecture · Leave a Comment