Note - In case of any install/version mismatch error trying installing node version 18.20.2 and repeat the above steps Make sure to delete node_modules folder in both root directory and in server folder
Note - make sure Java is installed. If not install Java before proceeding with Kafka setup.
Reference - https://kafka.apache.org/quickstart
— Download latest Kafka from this link - https://www.apache.org/dyn/closer.cgi?path=/kafka/3.7.1/kafka_2.13-3.7.1.tgz
- Extract the zip file and go inside the folder and change the below properties (this is make sure kafka can accept and process bugger files)
add these lines in ./config/server.properties:
message.max.bytes=15728640
replica.fetch.max.bytes=15728640
add these lines in ./config/consumer.properties:
fetch.message.max.bytes=15728640
add these lines in ./config/producer.properties:
max.request.size=15728640
— Run below commands inside kafka folder:
bin/zookeeper-server-start.sh config/zookeeper.properties
bin/kafka-server-start.sh config/server.properties
bin/kafka-topics.sh --create --topic transactions --bootstrap-server localhost:9092 max.message.bytes=4096
Note - If you want to restart kafka, CTRL+C all the scripts and run the below command to clean it. After this all the above scripts can be run to start it again.
rm -rf /tmp/kafka-logs /tmp/zookeeper /tmp/kraft-combined-logs
Note - Once the UI is up and running, click on ‘Reset system’ button once - this will reset all the existing data and create the DB tables required.
==============
Proper validations for each field in the file (Right now, I have only the shell implemented)
Handling other file types
Encryption/Decryption for all data exchange
User authorizations and access tokens for API calls
Unit test cases/ Functional test cases creation for all files
Use react-virtualize/pagination to display huge transaction list as table
Handling amount transfer when target account name is not specified