iXora Custom Software Development Blog

Nowadays most of the developers are working with modern programming languages like Java, C#, Ruby, Python, Scala and many more. Most of the programming languages syntax are similar to each other at least its own groups/types (static, dynamic, scripting, functional etc). One example might be Java and C#. Both have similar syntax, Ruby and Python is another example. Interesting thing is Linux Shell (bash) programming syntax has unique style which has very few similarities with other languages. Few syntax is very unusual and it creates lots of problem for developers who come from other platform. Here I explain that type of syntax. 1#...

Corporate software development is much more team effort then individual. Most of the cases we work in a team. Real situation may happen like the team (team member) is managed by a manager who work from another country. In that case we can say him/her offshore software development manager. Here I write few tips (of course real life experiences) those may help us to work efficiently with remote manager. 1. Before start working with her (offshore manager), we should study on her. We should know her technical background, professional experience, personal preferences etc. It will help us to build a strong...

Often Linux shell script file is needed for Linux administrator for their regular jobs. Those shell scripts may contain few lines of statement. In that case, you can ignore many standards, useful tips. But we may need to write shell script for part of application process like data-warehouse ETL process. In that case our shell script may contain several lines of statement with many functionalities. In that case we have to think about code

Source data files may exists/uploaded in FTP location. We need to know file names of those and also need to download those files to local Linux box. Because we want to extract those files and stage in relational database for data-warehouse. It will be the part of ETL process.If we just want to get file names which are uploaded to FTP location, we have to create a bash function. Inside that function we will create an FTP interaction session.

Often we need to download data files from SFTP location. Specifically if we work with data-warehouse type project, our source data may uploaded in SFTP location. In ETL process, we need to integrate that data to our data-warehouse. In that case we need to download those files to local machine and then we staged that data to our database for further processing.

We may need to download files from SFTP location. I got a requirement where files need to download from SFTP location in Linux platform. Those are data files. File download process was  part of ETL process. Our target SFTP location contains previously processed and latest (unprocessed) both types of files. But we need to download only latest (unprocessed) files. Before download the unprocessed file we have to identify unprocessed files. Each data file contain date-stamp. Based on that date-stamp we can capable to identify those files. So we need to fetch all file names first then we have to go for...

Array is very important data structure in any programming language. Almost all programming languages support array. Modern languages have list, dictionary, stack, queue, linkedlist data structures. So very few times actually array is used. Linux has built in bash shell scripting language. This bash script has only array data structure and it does not support any dictionary, list type data structure. So array is very important here and also array usage (declare, assign, read, traverse) is more difficult than other object oriented languages array. So array has little more learning curve in bash script than others. Creating/Assigning array variable: You can...