| Job Profile |
Working s a part of a Data supervision and Analytics team, the integrity and the consistency of data is what me and my team is primarily focused on.
It is a part of Big Data testing where huge volumes of data are first extracted and then transformed to validate its consistency with the client data which is stored in Hbase.
The extraction and transformation is done in Hive using HiveQL and the comparison between source data which is derived from Hive tables and the target data which is present in Hbase is done in Unix through Perl scripting. |
