iXora Custom Software Development Blog

Often we need to download data files from SFTP location. Specifically if we work with data-warehouse type project, our source data may uploaded in SFTP location. In ETL process, we need to integrate that data to our data-warehouse. In that case we need to download those files to local machine and then we staged that data to our database for further processing.

We may need to download files from SFTP location. I got a requirement where files need to download from SFTP location in Linux platform. Those are data files. File download process was  part of ETL process. Our target SFTP location contains previously processed and latest (unprocessed) both types of files. But we need to download only latest (unprocessed) files. Before download the unprocessed file we have to identify unprocessed files. Each data file contain date-stamp. Based on that date-stamp we can capable to identify those files. So we need to fetch all file names first then we have to go for...

Array is very important data structure in any programming language. Almost all programming languages support array. Modern languages have list, dictionary, stack, queue, linkedlist data structures. So very few times actually array is used. Linux has built in bash shell scripting language. This bash script has only array data structure and it does not support any dictionary, list type data structure. So array is very important here and also array usage (declare, assign, read, traverse) is more difficult than other object oriented languages array. So array has little more learning curve in bash script than others. Creating/Assigning array variable: You can...

Solution #1: SELECT * FROM ( SELECT TOP 3 ROW_NUMBER() OVER(ORDER BY DateOfBirth) AS row,* FROM Employee ) Emp WHERE row=3 Solution #2: SELECT TOP 1 * FROM ( SELECT TOP 3 * FROM Employee ORDER BY DateOfBirth ) Emp ORDER BY DateOfBirth DESC If any more solutions please comment....

80/20 Rule is a very common term for different systems. I believe most of you realized that rule while running a project or maintaining the functional job.  It is also true for software development.  I have experienced several projects where 80% tasks were done using 20 % time and effort and 20 % tasks of the project demanded 80% time and effort. If you fail to understand the combination of your project tasks then there is a higher possibility that you may fall into trouble executing the project.  To make success of the project you need to take extra care for those 20% tasks.