Possible reasons for Processor's Data Provenance of Apache Nifi not displaying data
Below are some of the possible reasons that the Processor's Data Provenance of Apache Nifi not displaying data
1. No rights to write data in the directory or Disk storage issue
Nifi maintains some repositories for persisting the data like Content Repository, Flow Repository, Provenance repository. So the application may not be having writing rights so there is no data in the Data provenance
2. Incorrect Data/Time of the machine
There is a property in nifi.properties
nifi.provenance.repository.max.storage.time
The maximum amount of time to keep data provenance information. The default value is 24 hours
So the nifi time and the machine time is different then adjust this duration accordingly.
3. Applied Filter
There is a possibility that in the Data provenance screen some filter is applied that does not return any records. Try to clear the search.
4. Data provenance is not persisted
Check nifi.properties file for "nifi.provenance.repository.implementation" property.
If it has "VolatileProvenanceRepository" value that means it is an in-memory repository
# Provenance Repository Properties
nifi.provenance.repository.implementation=org.apache.nifi.provenance.VolatileProvenanceRepository
For persistent it should be "PersistentProvenanceRepository"
# Provenance Repository Properties
nifi.provenance.repository.implementation=org.apache.nifi.provenance.PersistentProvenanceRepository
For more information, check the log files i.e. nifi-app.log. It has data provenance queries, the time taken by the queries, etc. This will also have some more information of exceptions if occurred.
1. No rights to write data in the directory or Disk storage issue
Nifi maintains some repositories for persisting the data like Content Repository, Flow Repository, Provenance repository. So the application may not be having writing rights so there is no data in the Data provenance
2. Incorrect Data/Time of the machine
There is a property in nifi.properties
nifi.provenance.repository.max.storage.time
The maximum amount of time to keep data provenance information. The default value is 24 hours
So the nifi time and the machine time is different then adjust this duration accordingly.
3. Applied Filter
There is a possibility that in the Data provenance screen some filter is applied that does not return any records. Try to clear the search.
4. Data provenance is not persisted
Check nifi.properties file for "nifi.provenance.repository.implementation" property.
If it has "VolatileProvenanceRepository" value that means it is an in-memory repository
# Provenance Repository Properties
nifi.provenance.repository.implementation=org.apache.nifi.provenance.VolatileProvenanceRepository
For persistent it should be "PersistentProvenanceRepository"
# Provenance Repository Properties
nifi.provenance.repository.implementation=org.apache.nifi.provenance.PersistentProvenanceRepository
For more information, check the log files i.e. nifi-app.log. It has data provenance queries, the time taken by the queries, etc. This will also have some more information of exceptions if occurred.
Thanks for sharing such an informative Article. It will be beneficial to those who seek information. Continue to share your knowledge through articles like these.
ReplyDeleteData Engineering Solutions
Artificial Intelligence Services
Data Analytics Services
Data Modernization Services
I appreciate you taking the time and effort to share your knowledge. This material proved to be really efficient and beneficial to me. Thank you very much for providing this information. Continue to write your blog.
ReplyDeleteData Engineering Services
Artificial Intelligence Solutions
Data Analytics Services
Data Modernization Solutions