Practical BigData Course with Live Project using Agile methodology

If you are thrilled by the "Big Data " buzz world and planning to jump on to it. Think Again. Although it may see promising Bigdata /Hadoop based carrier could be challenging. With so many different course available each claiming to be best , you are more likely to get confused then to get convenience .

It was these factors which forced to be join and give a more realistic and practical option for Hadoop skillset for genuine folks. Much of the content and inputs of the course is based on my  experience in BigData domain for last 5 years from a total of 16 + exp..

Please join linked in group for regular updates on my learning in Hadoop / Bigdata Real time work.

http://www.linkedin.com/groups/Online-Hadoop-Training-4838165

Sample Session:

Please refer below vids as sample from training session. i hope that should help you make up your mind. 

Training Course Details Session:

https://www.youtube.com/watch?v=ij3v4mYKxHw

Hadoop HDFS Lab:

 Introduction to HADOOP

• Distributed computing , cloud computing
• Big data Basics and Need for Parallel Processing
• How Hadoop works ?
• Introduction to HDFS and Map Reduce

 Hadoop Architecture Details

• Name Node
• Data Node
• Secondary Name Node
• Job Tracker
• Task Tracker
• Safe Mode , FS Image and Edit log details

HDFS ( Hadoop - Distributed File System)

• Hadoop Distributed file system , Background, GFS
• Data Replication
• Data Storage
• Data Retrieval
• Additional HDFS commands
• HDFS Upgrade steps
• NameNode Failure recovery steps and execution.
• HDFS - Java API for Interaction with FS.
• Node Decommissioning 

 MapReduce Programming

• MapReduce, Background
• Writing MapReduce Programs
• Writable and WritableComparable
• Input Format, Output Format
• Input Split and Block size
• Combiner
• Partitioner
• Number of Mappers and Reducers
• Counters

Map Reduce Algorithms and Exercises

• Sentiment Analysis using Facebook , Twitter and Youtube data
• Frequency Count example with variations of MR .
• Eclipse based development of end to end MR Job and Deployment.
• Sorting Data using Key value Data Type Lab
• Exercises- Martix , Partitioner, No Reduce, Distributed Cache Labs

Hadoop Streaming

• Introduction to Hadoop Streaming
• Streaming API details and use cases
• Python Based Example for Streaming API
• Exercise for Hadoop Streaming ( XML Files ) Based.
• Exercises on Ruby
• Exercise on C# using MS-Azure.

Apache Pig

• Installation and configuration
• Execution Types - Local , MR modes
• Grunt Shell - Configuration 
• Pig Latin - Examples and code
• Data Processing using Pig Latin
• Loading and Storing Pig Functions
• Data Filtering
• Grouping & Joining Operations
• Hands on Exercises

Apache HBase Installation and Details

• HBase and NOSQL Introduction
• HBase Installation and Configuration.
• HBase and Java Based integration
• Hbase basic exercises

 Apache Hive  Instalaltion and Details

•     Hive Installation on Single cluster Hadoop Node.
•     Hive Services
•     Hive Shell Description
•     Meta store Details
•     Hive QL Basics
•     Working with Tables, Databases etc.
•     Hive JDBC programming
•     Hands on Exercises and Assignments

Introduction to Amazon Map Reduce (AWS-EMR)

• Hadoop using Amaozon Web Service
• AWS MapReduce and EC2 
• AWS - S3 Service Model.
• AWS-MR Architecture.
• Streaming Exercise using EMR JobFlow.

Hadoop Infrastructure Planning

• Basic Hadoop hardware and software req
• Small , Medium and Large cluster 
• Networking challenges in Hadoop Deployment
• Disaster Recovery ( DR ) in Hadoop .
• Performance Tuning a large cluster

 Hadoop Industry Solutions

• EMC GreenPlum Introduction
• IBM BigInsight Details

-----------------------------------------------------------------------

People planning to move from Mainframe, SAP , ERP ,.NET domain get specialized consultancy help to map there existing skillset and tune it as per Hadoop related job opportunities.
We go with a end to end , 3 phase approach to cater to your need for not only helping you with training but also with interview preparation and later job support.

• Complete Hadoop and Eco system Training 
• Live Interview Preparation with mock interviews
•  Job support with coding help

Training Includes :
- Live and offline training on Hadoop , Ecosystem projects 40 Hours of recorded live training.
- 40+  Hadoop fully solved exercises (pdf form)
- Red Hat OS based Virtual machine for Labs.
- 2 set of Certification help questions
- Sample Resumes for Admin and Developer skillsets

Support includes :
- Helping and guiding student on day to day work w.rt to Hadoop.
- Coding and Helping with design suggestion for Hadoop , Hive , Pig and other tasks.
- Helping with documentation as needed - Design doc, Testing doc etc.
- Coding any Java related stuff as part of Hadoop Work.

Interview Preparation: 
- Walk through of Real time case study covering all Hadoop related tasks and questions.
- Writing and Discussing your resume and accordingly assessing your competency level
- 3 Mock Interviews on HDFS , Map Reduce and Misc Hadoop Topics .
- Sharing 2 certification Question Set .
- Guiding how to do Hardware estimation, Software configuration , Map Reduce code deployment etc.

You also has my open linked in forum to ask question with a Panel of experts .

Lastly about myself. I am 15+ exp Lead Hadoop Architect working for a Leading Financial Company . MY carrier spans across distributed programming , SOA and Cloud domain before moving to BigData space few years back.

Email: onlinetraining2011@gmail.com 

Skype:  onlinetraining2011

Course duration: 40 Hours
Medium:  GotoMetting

Online IT Training and Support

Apache Hadoop and AWS-Map Reduce Training

• http://onlinetraining2011.blogspot.com/2012/12/apache-hadoop-and-aws-mapreduce-training.html

Oracle SOA and BPEL Training

• http://www.onlinetraining2011.blogspot.com/2012/08/12-years-experience-oracle-architect.html

Complete Java and J2EE Training

• http://www.onlinetraining2011.blogspot.com/2012/09/this-training-is-for-people-targeting.html

Java/J2EE Architect Training

• http://www.onlinetraining2011.blogspot.com/2012/11/j2ee-application-architect-training.html

TOGAF V9 Foundation Course

• http://onlinetraining2011.blogspot.com/2012/12/togaf-v9-foundation-certification.html

Spring Framework Training

• http://www.onlinetraining2011.blogspot.com/2012/08/spring-framework-training-details.html

Hibernate Framework Training

• http://www.onlinetraining2011.blogspot.com/2012/08/hibernate-framework-course-details.html

Web Services Training

• http://www.onlinetraining2011.blogspot.com/2012/08/j2ee-web-services-course-details-xml.html

Job Support

• Oracle SOA 11g , BPEL ,OSB
• TOGAF V9, ITIL
• Cloud Computing- AWS 
• Hadoop and Map reduce
• Mobile ( Android )
• Java 1.5
• J2EE ( Spring, Hibernate, Web Services, JSF)
• AJAX, JQuery etc
• Resume and Interview Preparation

Email:  onlinetraining2011@gmail.com

HADOOP Insurance Domain Case Study

Insurance Company Case Study - Hadoop /Bigdatasolution:

We have this basic use case to implement using Bigdata solutions:

An insurance company with regional offices in each state is in business of Home and Auto Insurance.

**Each regional office send the details of monthly transaction ( enrollments , updates to policy , cancellation) to Central System

**The feed is form of Raw txt file converted by Mainframe system and sent to central processing server (Linux ) using FTP.

** The data is in FIXED line format .

1 single line contains :

- Transaction ID,
- SSN ,
-InsuranceID ,
-RegionalOfficeID,
-Insurance Type
- Insurance Duration
-Amount
-Notes
-Timestamp

Business Need:

The Company wants to launch a new product for Home and Auto insurance users and the management would like to give some real time facts based on the data they have like:

- No of user using the insurance national wide

- Pace with which the users are joining

- Which type of insurance package ( Home , Auto , Dual ) is more lucrative to customers as per their location geographies.

.

Some Hard Numbers:

No of users: 20 Million
Data File feed size: 50 MB / Cycle
No of Data cycles: 2 / week.
Time expected for output: Monthly Basis

Please analyse this business problem and provide your inputs for design and technology choice

Please join this forum and add your inputs. If you need more clarifications , please let me know the same. Wherever possible make suitable assumptions based on your exp and the type of work you have done.

I am looking for multiple options to design this solution.

Linkedin group:

http://www.linkedin.com/groups/Insurance-Company-Case-Study-Hadoop-4838165.S.256068004?qid=85f1e8b4-3a8c-458b-a1d6-cc206fc05309&trk=group_most_recent_rich-0-b-ttl&goback=%2Egmr_4838165

TOGAF V9 Foundation Certification Training

TOGAF Training Details:

The basic concepts of Enterprise Architecture and TOGAF

• The core concepts of TOGAF 9

• The key terminology of TOGAF 9

• The ADM cycle and  the objectives of each phase, and how to adapt and scope the ADM

• The concept of the Enterprise Continuum; its purpose and constituent parts

• How each of the ADM phases contributes to the success of enterprise architecture

• The ADM guidelines and techniques

• How Architecture Governance contributes to the Architecture Development Cycle

• The concepts of views and viewpoints and their role in communicating with stakeholders

• The concept of building blocks

• The key deliverables of the ADM cycle

• The TOGAF reference models

• The TOGAF certification program


Materials:

•  2 Mock Test papers.
•  Certification Prepertion Help

J2EE Application Architect Training

Application Design Concepts and Principles

•   Explain the main advantages of an object-oriented approach to system design including the effect of encapsulation, inheritance, and use of interfaces on architectural characteristics.
• Describe how the principle of "separation of concerns" has been applied to the main system tiers of a Java Platform, Enterprise Edition application. Tiers include client (both GUI and web), web (web container), business (EJB container), integration, and resource tiers.
• Describe how the principle of "separation of concerns" has been applied to the layers of a Java EE application. Layers include application, virtual platform (component APIs), application infrastructure (containers), enterprise services (operating system and virtualization), compute and storage, and the networking infrastructure layers.

Common Architectures

•    Explain the advantages and disadvantages of two-tier architectures when examined under the following topics: scalability, maintainability, reliability, availability, extensibility, performance, manageability, and security.
•     Explain the advantages and disadvantages of three-tier architectures when examined under the following topics: scalability, maintainability, reliability, availability, extensibility, performance, manageability, and security
•      Explain the advantages and disadvantages of multi-tier architectures when examined under the following topics: scalability, maintainability, reliability, availability, extensibility, performance, manageability, and security.
•      Explain the benefits and drawbacks of rich clients and browser-based clients as deployed in a typical Java EE application.
•      Explain appropriate and inappropriate uses for web services in the Java EE platform

 Integration and Messaging

·      

•         Explain possible approaches for communicating with an external system from a Java EE technology-based system given an outline description of those systems and outline the benefits and drawbacks of each approach.
•         Explain typical uses of web services and XML over HTTP as mechanisms to integrate distinct software components.
•          Explain how JCA and JMS are used to integrate distinct software components as part of an overall Java EE application.

      Business Tier Technologies

•          Explain and contrast uses for entity beans, entity classes, stateful and stateless session beans, and message-driven beans, and understand the advantages and disadvantages of each type.
•          Explain and contrast the following persistence strategies: container-managed persistence (CMP) BMP, JDO, JPA, ORM and using DAOs (Data Access Objects) and direct JDBC technology-based persistence under the following headings: ease of development, performance, scalability, extensibility, and security.
•          Explain how Java EE supports the deployment of server-side components implemented as web services and the advantages and disadvantages of adopting such an approach.

Web Tier Technologies

•  State the benefits and drawbacks of adopting a web framework in designing a Java EE application
•  Explain standard uses for JSP pages and servlets in a typical Java EE application.
•  Explain standard uses for JavaServer Faces components in a typical Java EE application.
•  Given a system requirements definition, explain and justify your rationale for choosing a web-centric or EJB-centric implementation to solve the requirements. 

Section 6: Applicability of Java EE Technology

•         Given a specified business problem, design a modular solution that solves the problem using Java EE.
•          Explain how the Java EE platform enables service oriented architecture (SOA) -based applications.
•          Explain how you would design a Java EE application to repeatedly measure critical non-functional requirements and outline a standard process with specific strategies to refractor that application to improve on the results of the measurements for Enterprise Applications with Java EE Content Details

·         What is Enterprise Architecture?

•          An Architect’s Roles and Responsibilities
•         Introduction to TOGAF V9 Framework
•          Introduction to Zachman Framework

Developing a Security Architecture

•          Analyzing the Impact of Security in Distributed Computing
•          Examining Security in the Java EE Technology
•         Understanding Web Services Security

Understanding Non-Functional Requirements

•         Examining Non-Functional Requirements (NFRs)
•        Common Practices for Improving Qualities
•         Prioritizing Quality-of-Service (QoS) Requirements
•         Defining Common Problems and Solutions: Network, Transaction and Capacity Planning
•         Describing Network Communication Guidelines
•        Justifying the Use of Transactions
•        Planning System Capacity

Tools and Plug-in Overview

•          IBM Thread and Monitor Analyzer
•          JProfiler
•         JProbe
•          PMD
•          YSlow
•          SOAP UI 

Complete Java , J2EE Training by J2EE Architect

This training is for people targeting to have a all inclusive knowledge of JAVA and J2EE Frameworks( Spring , Hibernate ,Web Services ) Training by J2EE Architect.

The course will be mostly practical with specific emphasis on real time use of these technologies and how to make better design decision when using these in projects.

With my current role as J2EE architect, i will try to give more realistic approach for the use of these technologies and focus on real time application challenges.

Email: onlinetraining2011@gmail.com for more details and demo class.


Sample Videos:



Web Services:

www.youtube.com/watch?v=nfngZmyMW80

Hibernate:

www.youtube.com/watch?v=fjreWtfNTQY

Java Collection Labs:

www.youtube.com/watch?v=HD26F_2lujc


Study Material:

* Presentation/Decks for each topic
* Fully Solved examples.
* Exercises for each topic.
* Certification Question Papers.
* Resume Preperation Help.

--------------------------------------------------------

Core Java- Part1 Java Basics

• History of Java
• OOPs Concepts
• Java Architecture
• JVM Architecture
• Java Syntax
• Java Execution Engine Process
• Class File Format
• Simple Java Program
• Class / Abstract Class / Interface
• Predefined Classes and Packages
• Predefined Key words
• Object Class Details
• Static Methods and Static Blocks
• Access Specifier ( Internal Structure)
• Exception Handling Framework
• Exception Concepts ( try, catch, finally)

Core Java- Part2 Advance Topics

• Introduction to Object Oriented Programming
• Inheritance : Details
• Polymorphism : Details
• Encapsulation and Abstraction
• Constructor Chaining
• Threads- Introduction
• Thread Creation- Thread Class and Runnable
• Thread Life Cycle
• Thread Communication Model
• Thread Synchronization
• Garbage Collection
• Collection Framework: Introduction
• Types of Collection.( List , Set , Map)
• Differences between Collection APIs
• Accessing Collection Objects: Iterator API

---------------------------------------------------------------------

Spring Framework Course Details:

•          Overview of Spring
•          Benefits of Spring
•          Spring Architecture

 Spring IOC ( Inversion of Control)

•          Beanfactory Details.
•          XMLBeanFactory
•          Advantages of IOC
•          Instantiating POJOs using BeanFactory
•          Collection Injection

 Spring AOP

•          Spring AOP (Aspect Oriented Programming)
•          Benefits of AOP
•          AOP Terminology
•          Aspects ,Advices, Point cut etc.
•          Developing AOP application.

 Spring DAO / JDBC

•          Spring DAO  (Spring JDBC)
•          Developing data centric applications using Spring DAO
•          Using JdbcTemplate class
•          Executing queries , stored procedures and processing results

 Spring MVC

•          Spring MVC for Web Development.
•          Developing web applications using Spring.
•          Using Controller , view classes.
•          Developing Simple view objects.
•         Spring3 MVC Annotations.   

 Spring ORM

• Spring ORM Module: Introduction
• Spring Hibernate Integration Details.
• Developing a end to end Spring  and Hibernate Application.

---------------------------------------------------

Hibernate Course Details


Introduction to ORM Domain

• Object/Relational Paradigms 
• O/R Mismatch 
• Object Relational Mapping (ORM) 
• Java ORM/Persistent Frameworks 

Hibernate Architecture

• Hibernate Architecture and APIs.
• Hibernate Installation/Setup 
• Setup Configuration Files
• Setup Mapping Files 

Introduction to Hibernate Persistence 

• What is Persistance
• JavaBeans and POJOs 
• Basic Mapping Concepts
• Class to Table Mappings 
• Property to Cloumn Mapping 
• Generators , Primary Keys identifier etc
• Quoting SQL Tables and Columns 

Hibernate Persistance API

• SessionFactory Details
• Session API Details
• Transaction API
• Session.save() and session.load()
•  Session.flush()

Hibernate Collections

• Hibernate Collection Mapping
• Mapping Arrays
• Mapping Map
• Mapping Set
• Mapping Bags
•  Mapping List

Hibernate Associations

• Introduction to Associations
• One-to-one Association
• Many-to-one Association
•  One to Many  Association
• Many-to-many Association

HQL (Hibernate Query Language)

• HQL Introduction.
• Hibernate Object Fetching Options 
• Hibernate Query 
• HQL Parameters 
• Named Queries 
• Native SQL 

Hibernate Criteria

• Criteria API Introduction
• Expression API and Restrictions API
•  Criteria Associations.
•  Criteria based nested queries.
•   Performance comparison with HQL.

Hibernate Caching

• Caching Introduction.
•  Types of Caching
•  Transaction Level Isolation.
•  Caching Providers( Ehcache etc)
•  Caching configuration in xml files
•  Query based caching.

----------------------------------------------

Web Services Course Details

Web Services Core:

• Web Services Introduction
• XML Basics ( XML ,DTD , Schema, Parsers)
• SOA Introduction.
• SOAP Details
• WSDL Details

J2EE Web Services :

• J2EE Web Services
• JAX-RPC ( Top-Down and Bottom-Down Approach)
• JAX-WS Service and Client Details
• JAXP ( SAX,DOM Parsers)
• JAXB ( Java API for XML Binding)
• Web Services Client
• Java2WSDL and WSDL2Java methodologies.
• SAAJ( Soap With Attachment API for Java)

RESTFul Web Services

• RESTful web service introduction
• REST Jersey Based web services ( JAX- RS)
• RESTful Service Provider.
• RESTFul Client details
• REST vs SOAP

Web Services Security

• Web Services Security
• XML Signature
• XML Encryption

Web Services Testing

• SOAP-UI Introduction
• Testing Web Services using SOAP-UI

Email: onlinetraining2011@gmail.com for more details and demo class.

Thanks everyone for visiting this page. Appreciate your feedback and inputs.

J2EE Web Services Course Details

XML and related technologies

• XML Overview
• XML Schema Defintion (XSD)  

Overview of Web Services

• Why Web Services?
• Service-Oriented Architecture
• HTTP Protocol
• Simple Object Access Protocol (SOAP)
• Web Service Description Language (WSDL)
• RESTFul web servcies  

Java API for XMl Processing(JAXP)

• JAXP Introdcution
• Overview of SAX
• Overview of DOM
• SAX Parser
• SAX Parser Example
• Handlers
• Parser With a Handler
• Error Handlers
• DOM Parser
• Error Handling
• DOM Nodes
• The Document Interface
• Creating an XML Document
• Exercises and Assignments

Java API for XML Binding (JAXB)

•  JAXB Introduction
•  Schmema to Object Mapping
•  Marshalling and Unmarshalling Features
•  XJC complier usuage
•  Object to XML Conversion
•  XML to Object COnversion

 The Simple Object Access Protocol( SOAP)

• SOAP Messaging Model
• SOAP over HTTP
• The SOAP Envelope
• SOAP Body and SOAP Header
• Document and RPC Mode of Communcation
• RPC Literal and Encoded Types
• SOAP Faults.
• SOAP 1.1 and SOAP 1.2 Faults

 Web Services Description Language( WSDL)

• Web Services as Component-Based Software
• The Need for an IDL (Interafce Definition Language)
• WSDL Structure Deatils
• The Abstract Model -- Service Semantics
• The Concrete Model -- Ports, Services, Locations
• Extending WSDL -- Bindings
• Service Description

 The SOAP with Attachments API for Java (SAAJ)

• The SAAJ Object Model
• Parsing a SOAP Message
• Creating a SOAP Connection
• Using SAAJ API to communciate to WS

Java API for XML Based Web Services (JAX-WS)

•          JAX-WS Basics
• The @WebService Annotation
• The @WebMethod Annotation
• The @WebParam Annotation
• The @Return Annotation

Java API for Remote Procedure Call (RPC)

• JAX-RPC Introduction
• Java to WSDL Approach
• WSDL to Java Approach
• Service Provider Implementation

JAX-RPC Client-Side Development

• Using WSDL to generate client side code
• Stubs and Proxies
• Generated Code
• Locating a Service
• Invoking a Service

RESTFul Web Services (JAX-RS)

• Introduction to REST
• REST and  HTTP
• RESTful Architectural Principles
• Designing RESTful Services
• Model the URIs
• Assigning HTTP Methods
• Your First JAX-RS Service
• Developing a JAX-RS RESTful Service
• Deploying Our Service on Jersey Container

Rest vs SOAP 

•         Comparison of REST and SOAP
• Usage scenarios for REST and SOAP
• Integrated Approach

Web Services Security

•    Introduction to WS-Security
•    Security Architecture Taxonomy
•    XML Signature
•    XML Canonicalization
•    Public and Private Key Encryption

Training Materials:

1) Presentation and Decks.
2) Exercises for each module.
3) Worked out examples.
4) Resume Preparation Guidance