Basic Understanding of Cloudera Flow Management - Apache NiFi

 Basic Understanding of Cloudera Flow Management - Apache NiFi


Topics:

  • NiFi Cluster Architecture
  • Content Repository
  • EncryptedContentRepository and other options
  • Provenance Repository
  • FlowFile Repository
  • FlowFile, Attributes, Process Groups, Connections, Flow Controllers
  • Controller Services
  • Custom Properties
  • Common Attributes (uuid, filename, path, file size, ...)
  • Expression Language
  • Flow Routing
  • Testing and Test Data Generation
  • Relationships
  • Ports
  • Bulletins
  • flow.xml.gz
  • Input Port
  • Output Port
  • Empty Queues
  • Setting Warning Levels
  • Funnels
  • Copy on Write
  • RecordPath 
  • Using Record Processors (Readers/Writers)
  • NiFi Toolkit
  • NiFi CLI
  • NiFi REST API
  • NiFi Registry Integration
  • Handling Errors
  • Parameter Context / Parameters
  • Summary / Cluster / Bulletins
  • Reporting Tasks
  • Sizing NiFi Cluster on # of records * size / amount of time
  • Configuration Files (Changing RAM)
  • Understanding NiFi logs
  • How to add custom processors
  • JVM 
  • Back pressure
  • Prioritized Queues
  • Load Balancing
  • Load Balancing Strategies
  • Prioritization
  • Monitoring a Flow
  • Using Search
  • Using Documentation
  • Classloader
  • Site-to-Site Communication / Remote Process Groups
  • Extensions
  • Scheduling
  • Tailing Files
  • Reading sFTP/FTP Files
  • Wait and Notify
  • RetryFlowFile Pattern
  • NiFi Calcite SQL 
  • Using Jolt
  • Using JsonPath
  • Using Kerberos
  • Using SSL
  • Making REST Calls
  • Receiving REST Calls
  • Working with Websockets
  • Working with TCP/IP, UDP, Sockets
  • Working with Files, Logs, Syslog
  • Producing and Consuming Kafka
  • Working with HDFS
  • Reading/Writing Hive
  • Reading/Writing Impala/Kudu
  • Reading/Writing HBase
  • Integration with Ranger
  • Integration with Knox
  • Integration with Atlas
  • LookupRecord
  • Working with Caches
  • Restarting Flows
  • Pass by Reference
  • Working with XML
  • Working with JSON
  • Working with AVRO
  • Working with Schema Registry
  • Using Regular Expressions
  • Funnels




Must read:


Email Post