HADOOP : Load and store command in PIG

The below script show how to load the data file for processing using LOAD command.


grunt> VAR = LOAD 'sample.csv' USING PigStorage() AS (lines:chararray);

grunt> STORE VAR into 'sampleout.csv' USING PigStorage();

The STORE command is used to store the output of contents to the output file.

Comments

Pokemon Go download link

Pokemon go has become the buzz word in tech industry now. Nintendo, the Japanese video game company are the creates of this game. Its first of it kind to integrate a game with augmented reality , so people has to go out to real world with there android or iPhone to catch em all . You can download Pokemon go from this link.

Primitive datatypes in hive

String data types STRING VARCHAR CHAR TINYINT SMALLINT INT BIGINT FLOAT DOUBLE DECIMAL BOOLEAN TIMESTAMP DATE

UNIX : How to ignore lines with certain names

Sometimes we need to ignore multiple lines with certain words and get the list out of the file. usually it will be a log file to read . The below grep command can be used to ignore multiple words present in a text file. Lets say the file contain $ cat list.txt apple orange apple banana papaya Now we need to ignore line with orange , banana and papaya . So we can use the below grep command. $ cat list.txt | grep -Ev "orange|banana|papaya" apple apple It will ignore lines with the words in -v part of grep.

Tech Info Talks

Search This Blog