ITechShree-Data-Analytics-Technologies

How to create Maven Spark project in Eclipse(Using Java)


Maven is a dependency manager tool which eases programmer in managing dependencies for multi module project.


Let's discuss with an example how we can create maven project.


Requirements:

    1. Download Eclipse for Java EE developers from official Eclipse site

          https://bit.ly/344m19e

     Download eclipse depending on system configuration



  1. Download Apache Maven from official maven.

    https://bit.ly/3lUAlHf

Download below source file for Maven.




Creating local repository and set path in maven settings:

  • Now create a folder in desktop named repository

  • Then copy the local path of repository folder

  • paste the path under local repository in maven settings.xml file

  • Now open eclipse

    Click Windows->Preferences->Maven->User settings->click browse the select the path for maven settings.xml->then click update settings

  • A pop up message will come then select yes .It would automatically set the local repository path .




Creating Maven project:


1.   Open eclipse then go to File->New->Project->Maven->Maven project->Click Next



Now select checkbox (Create a simple project)->Click Next-



Now give a name for groupid(Maven_java_pro) and artifact id(java_pro1) -> click Finish





2. Now create a package under source folder following below screen shot .

Right click on src/main/java ->New->Package->Name a package name (java_learning)->Click Finish





3. Now create a java class under java_learning pacakge.
Right click on java_learning  ->New->Class->Name a class name (Mypro)->Click Finish





4. Now update project using maven update


Right click on project ->Maven->Update project



 Now Let's see how maven works as dependency manager.


If  I write Spark Program in java then I am getting error .






Now I shall add spark dependency depending on spark version used in pom.xml file.

Go to maven repository official site.



Then, add spark dependency in pom.xml file




Once Pom.xml file gets saved after adding changes ,This mavenized project starts updating .Thus maven will automatically start downloading  Spark libraries in repository folder.

Now we can resolved the error occurred due to Spark class.




Now You get to know about creating spark project  using Maven.

Try more!!
Happy Learning !!

Debashree








Post a Comment

0 Comments