Skip to main content

PIG : Reading data from file


To read the data from a file we can use the LOAD command. Assume there is a file named player.csv (downloaded public dataset of english premier league player from one of the open data set).

Sample Data from player.csv file

Player id,Player,Position,Number,Club,Club (country),D.O.B,Age,Height (cm),Country,Caps,International goals,Plays in home country
336722,Alan PULIDO,Forward,11,Tigres UANL,Mexico,08.03.1991,23,176,Mexico,5,4,TRUE
368902,Adam TAGGART,Forward,9,Newcastle United Jets FC,Australia,02.06.1993,21,172,Australia,4,3,TRUE
362641,Reza GHOOCHANNEJAD,Forward,16,Charlton Athletic FC,England,20.09.1987,26,181,Iran,13,9,FALSE

Pig script to load the data. We must specify the record structure of the file.

grunt> player_data  = LOAD 'players.csv'
       USING PigStorage(',')
       AS
       (player_id:int,
       player:chararray,
       position:chararray,
       number:int,
       club:chararray,
       club_country:chararray,
       d_o_b:chararray,
       age:int,
       height_cm:int,
       country:chararray,
       caps:chararray,
       international_goals:chararray,
       plays_home_country:chararray);

grunt> DUMP player_data;

Sample Output

(380000,Marcelo BROZOVIC,Midfielder,14,GNK Dinamo Zagreb,Croatia,16.11.1992,21,180,Croatia,0,0,TRUE)
(380009,Luis LOPEZ,Goalkeeper,1,Real Espana,Honduras,13.09.1993,20,182,Honduras,0,0,TRUE)
(379910,Adnan JANUZAJ,Midfielder,20,Manchester United FC,England,05.02.1995,19,180,Belgium,0,0,FALSE)



Labels:

Comments

Post a Comment

Popular posts from this blog

Pokemon Go download link

Pokemon go has become the buzz word in tech industry now. Nintendo, the Japanese video game company are the creates of this game. Its first of it kind to integrate a game with augmented reality , so people has to go out to real world with there android or iPhone to catch em all . You can download  Pokemon go  from this link. 
2 comments
Read more

How to share blog post ?

Hi.I will show you how to add social network sites icon to your blog post in Blogger.For that follow the steps. 1. Login to your Blogger. 2.Go to design tab. 3.Take Edit HTML tab. 4.You my expand the widget option.Give the check option on ' Expand Widget Templates' 5.Find the tag  <data:post.body/>
5 comments
Read more

UNIX : What is /dev/null ?

/dev/null is a file where you can discard the output of the command executed. This file is also called as Bit Bucket. eg : >ls -ltr > /dev/null > Here the output of command ls is never shown on terminal STDOUT. It is redirected to bit bucket. Sometimes we need not display the output as well as error message of command.In this case use the following command. > command > /dev/null 2>&1 The command output is redirected to /dev/null.Also the error output, STDERR (which is called by 2) is redirected to STDOUT (called as 1 ).That means the error will be redirected to /dev/null.
Post a Comment
Read more