iXora Custom Software Development Blog

Source data files may exists/uploaded in FTP location. We need to know file names of those and also need to download those files to local Linux box. Because we want to extract those files and stage in relational database for data-warehouse. It will be the part of ETL process.If we just want to get file names which are uploaded to FTP location, we have to create a bash function. Inside that function we will create an FTP interaction session.

Often we need to download data files from SFTP location. Specifically if we work with data-warehouse type project, our source data may uploaded in SFTP location. In ETL process, we need to integrate that data to our data-warehouse. In that case we need to download those files to local machine and then we staged that data to our database for further processing.

We may need to download files from SFTP location. I got a requirement where files need to download from SFTP location in Linux platform. Those are data files. File download process was  part of ETL process. Our target SFTP location contains previously processed and latest (unprocessed) both types of files. But we need to download only latest (unprocessed) files. Before download the unprocessed file we have to identify unprocessed files. Each data file contain date-stamp. Based on that date-stamp we can capable to identify those files. So we need to fetch all file names first then we have to go for...

Array is very important data structure in any programming language. Almost all programming languages support array. Modern languages have list, dictionary, stack, queue, linkedlist data structures. So very few times actually array is used. Linux has built in bash shell scripting language. This bash script has only array data structure and it does not support any dictionary, list type data structure. So array is very important here and also array usage (declare, assign, read, traverse) is more difficult than other object oriented languages array. So array has little more learning curve in bash script than others. Creating/Assigning array variable: You can...

Solution #1: SELECT * FROM ( SELECT TOP 3 ROW_NUMBER() OVER(ORDER BY DateOfBirth) AS row,* FROM Employee ) Emp WHERE row=3 Solution #2: SELECT TOP 1 * FROM ( SELECT TOP 3 * FROM Employee ORDER BY DateOfBirth ) Emp ORDER BY DateOfBirth DESC If any more solutions please comment....