Odysseus Wrapper
  1. Odysseus Wrapper

kafka

Public
AuthorCommitMessageCommit dateIssues
Marco GrawunderMarco Grawunder
49104c9675eMPull request #20: DevelopmentMerge in ODY_WRAP/kafka from development to master * commit '3c83afa31d12451ab7a39605fc2919abcc0e6f3f': start writing to buffer when marker was received new implementation of kafka transport handler for state management
Marco GrawunderMarco Grawunder
3c83afa31d1MPull request #19: State managementMerge in ODY_WRAP/kafka from state_management to development * commit '9f0c420ead5f6677724a8d4f8f2b33737d063c84': start writing to buffer when marker was received new implementation of kafka transport handler for state management
Tom GlaesekerTom Glaeseker
9f0c420ead5start writing to buffer when marker was received
Tom GlaesekerTom Glaeseker
b2652f4621fnew implementation of kafka transport handler for state management
Marco GrawunderMarco Grawunder
1969ab3d94fMPull request #18: Removed plugin dependencyMerge in ODY_WRAP/kafka from development to master * commit '144384ea2db1c3297e1468a9cad82698c59259ca': Removed plugin dependency
Marco GrawunderMarco Grawunder
144384ea2dbRemoved plugin dependency
Marco GrawunderMarco Grawunder
1a7b0554e8fMPull request #17: DevelopmentMerge in ODY_WRAP/kafka from development to master * commit 'd93f13c167cd4b402fe8292f019e6124e0c1b472': Odysseus_dev update Removed plugins
Marco GrawunderMarco Grawunder
d93f13c167cOdysseus_dev update
Marco GrawunderMarco Grawunder
d9de110cf88Removed plugins
Marco GrawunderMarco Grawunder
c6d2c48664cMPull request #16: ODY-2189: Properties cannot be static!Merge in ODY_WRAP/kafka from development to master * commit '4ae4ec61742d87d374e00707f5e7d47d9a53a20a': ODY-2189: Properties cannot be static!ODY-2189
Marco GrawunderMarco Grawunder
4ae4ec61742ODY-2189: Properties cannot be static!ODY-2189
Marco GrawunderMarco Grawunder
e316875a351MPull request #15: DevelopmentMerge in ODY_WRAP/kafka from development to master * commit '06bf92ed2d0dc38cc37910400a4df12d6dd0fb06': Scala not needed Update to latest kafka libs
Marco GrawunderMarco Grawunder
06bf92ed2d0Scala not needed
Marco GrawunderMarco Grawunder
7b50e200da8Update to latest kafka libs
Marco GrawunderMarco Grawunder
0e1a2b20453MPull request #14: DevelopmentMerge in ODY_WRAP/kafka from development to master * commit '28baaa786cf7abb51b301098d1ab5cd7098b4d8b': Submodule update Set encoding Allow to push prefs
Marco GrawunderMarco Grawunder
28baaa786cfSubmodule update
Marco GrawunderMarco Grawunder
23372563dacSet encoding
Marco GrawunderMarco Grawunder
685fab8671dAllow to push prefs
Marco GrawunderMarco Grawunder
46dce089a8bMMerge branch 'development'
Marco GrawunderMarco Grawunder
f97a6a6cb2eUpdate of extension for tycho
Marco GrawunderMarco Grawunder
f6eaf5062f6Removed Exec Env
Marco GrawunderMarco Grawunder
ed7d30846c4MMerge branch 'development'
Marco GrawunderMarco Grawunder
e95347d6146RemovedWarnings
Marco GrawunderMarco Grawunder
dd878f88b43MPull request #13: DevelopmentMerge in ODY_WRAP/kafka from development to master * commit 'a62c3bd4de3ae8e19e2d022491767cdced01505c': (44 commits) Change to only send offsets and commit and begin a new transaction if the offset list is not empty. Change default reading of operator states to false and only set explicitly or with a according mode. Move parsing of isolationLevel to initConsumer Fix checking mapIdState...
Torben LogemannMarco GrawunderTorben Logemann
a62c3bd4de3MPull request #12: Feature/ODY-2081 up and downstream commitment of kafka topics with marker synchronisation onMerge in ODY_WRAP/kafka from feature/ODY-2081-up-and-downstream-commitment-of-kafka-topics-with-marker-synchronisation-on to development * commit '126fe07d8b0f932be3d35d9dac1dae3cc4111e20': (38 commits) Change to only send offsets and commit and begin a new transaction if the offset list is not empty. Change default reading of operator states to false and only set explicitly or with a acco...ODY-2081
Torben LogemannTorben Logemann
126fe07d8b0Change to only send offsets and commit and begin a new transaction if the offset list is not empty.Fix logging general exception in KafkaTransportHandler. Fix read operator states with lower cased read_committed.
Torben LogemannTorben Logemann
1b330f211adChange default reading of operator states to false and only set explicitly or with a according mode.Fix to not set transactional.id when in no TransactionMode. Make sure to not set transactional.id in consumer properties.
Torben LogemannTorben Logemann
42b8b8aaec5Move parsing of isolationLevel to initConsumer
Torben LogemannTorben Logemann
149ff474239Fix checking mapIdState in method mergeMapIdState of Marker.Fix by removing now faulty @Override annotations. Add method processOperator method to Marker which sets initial state of saves the state in marker state.
Torben LogemannTorben Logemann
24786c22f3aChange parsing of TransactionMode by enum.Add TransactionMode.NONE and use it instead of null checking.
Torben LogemannTorben Logemann
f760dc6c924Change to use getString instead of get for all strings gotten form options in KafkaTransportHandler.
Torben LogemannTorben Logemann
69030ecc0ddFix setting isolation level for init of KafkaConsumer by lower case value.
Torben LogemannTorben Logemann
9232896654bRenamed static final variables in KafkaTransportHandler to upper case.Use parsing to IsolationLevel enum. Change to use option.getBoolean for Boolean types instead of own parsing. Change to use initial dynamic getting of (de)serializers in static final variables. Add kafka common to imported packages.
Torben LogemannTorben Logemann
d5b292608bfRevert kafka mep commands by uncommenting run method calls.
Torben LogemannTorben Logemann
4a8f8558be8Channge to use IOperatorState instead of AbstractOperatorState
Torben LogemannTorben Logemann
3e7c0df8228Remove apache-commons-lang3
Torben LogemannTorben Logemann
d4767ae6e70Fix using Line protocol with Kafka transport by removing not finished, custom metadata processing
Torben LogemannTorben Logemann
c51c7eaa811Fix adding to list and therefore committing input topic offset by adding one to current offset
Torben LogemannTorben Logemann
eac0c27d566Change to save operator states as map and not as keys mapped to states on one topic.Change the get and setByteArray methods in Marker so (de)serialize the whole id states map instead of only the states. Fix to use the consumer position for commitment of the operator states map.
Torben LogemannTorben Logemann
25d7fb2a087Revert "Commit the operator states topic initially with 0 offset."This reverts commit 3636215521f50317ab6650cebf90846231810a1e.
Torben LogemannTorben Logemann
0beb9077daeMMerge branch 'feature/ODY-2081-up-and-downstream-commitment-of-kafka-topics-with-marker-synchronisation-on' of ssh://git.swl.informatik.uni-oldenburg.de:7999/ody_wrap/kafka into feature/ODY-2081-up-and-downstream-commitment-of-kafka-topics-with-marker-synchronisation-onODY-2081
Torben LogemannTorben Logemann
ad23842c950Fix only process non-initial marker in sender KafkaTransportHandler.Fix commit position instead of last read operator states offset.
Torben LogemannTorben Logemann
3636215521fCommit the operator states topic initially with 0 offset.
Torben LogemannTorben Logemann
5d9d3dcd5c9Fix to right method name kafkaConsumerRunner.readOperatorStates in RunnerManager
Torben LogemannTorben Logemann
ee12061bbf0Remove unnecessary, not used mapQueryIdOperatorStatesOffset.Change mapQueryIdOperatorStates to be ConcurrentHashMap and omit the explicit synchronization. Change extraction of values to use the owner as the po. Add parsing of markerSendingDelay from userParameter and set it as delay between marker sending. Change to not send the operator states offset when no operator states are read. Use the operatorStatesTopic from the set userParam and not over the c...
Torben LogemannTorben Logemann
3b3160234b9Fix to commit the transaction in send only for TranscationMode.ELEMENTSAdd setting of realTimeDelay from userParameter
Torben LogemannTorben Logemann
0ef7218ca1aFix key to 'globalQueryId'
Torben LogemannTorben Logemann
a8935100575Override transactional.id with globalQueryId if present.Refactor extractValuesFromProtocolHandler to extractValuesFromOwner. Change getting OperatorOwner outside of extraction method. Set protocolHandler in the init method.
Torben LogemannTorben Logemann
deb360e2c88MMerge branch 'feature/ODY-2081-up-and-downstream-commitment-of-kafka-topics-with-marker-synchronisation-on' of ssh://git.swl.informatik.uni-oldenburg.de:7999/ody_wrap/kafka into feature/ODY-2081-up-and-downstream-commitment-of-kafka-topics-with-marker-synchronisation-onODY-2081
Torben LogemannTorben Logemann
e922debf372Fix not extract globalQueryId when sending and initially consumer-commit 0 for transaction.Fix not trying to extract globalQueryId by KafkaTransportHandler.send, it will be gotten over ConsumerRunner. Add comment, that no flushing is needed for transactional committing. Fix not using setProperty but put for Properties instead. Fix setting operatorStateOffset to 0 for commiting and checking on '>= 0' when setting the offset because committed reading needs to have committed something i...