Wednesday, April 26, 2017

Share folder in Window(O/s) & access in Hadoop(VM)

Hi all,

As we are focusing more on practical aspect we need big files to test/learn big data technology. In order to work on that we can share big files in our local machine (window) & can be access in hadoop using below action.


1.  Create Folder & share in our Windows System (ShareWindow)

2.  Then go to Virtual Machine
     Create Folder where we want to see share folder data (ShareVirtual)

3. Run Below command in order to see the content

         sudo mount -t vboxsf sharewindow sharevirtual

          
           (/Sharevirtual) in case different path

Hadoop Configuration File

Hello Guys,

Please keep this configuration(.xml) file handy in order to work in Hadoop Ecosystem.


  1. core-site.xml:    It contains the configuration settings for Hadoop Core such as I/O settings that are common to HDFS and MapReduce.


  1. hdfs-site.xml: All the configuration settings for HDFS daemons(background process), the namenode, the secondary namenode and the data nodes are specified or can be specified in this file.



  1. mapred-site.xml: Configuration settings related to MapReduce daemons : the job-tracker and the task-trackers can be done here.