This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.
Notarization with Intelligent Virtual Assistant with Blockchain and PLN technologies (NAVIRO)
Project completed on September 30, 2023.
Project context
Councilbox Technology researched and developed in this project the necessary technologies to have a prototype that minimizes the bureaucratic burden and facilitates the answer to doubts and questions with recommendations on corporate meetings, aimed at those companies that need to hold corporate governance meetings in person or remotely with electronic evidence and a notarization system.
The experimental prototype called “Notarization with Intelligent Virtual Assistant with Blockchain and NLP technologies (NAVIRO)” was implemented based on the development of new systems supported by Blockchain and Natural Language Processing, providing, among others, the following functionalities:
- Meeting administrators or managers can interact with a smart virtual notary through a chat window, both by voice and text, to obtain information about past meetings and resolve questions related to legislation. The system improves its results through various feedback mechanisms.
- The smart virtual notary transcribes the public audio of the meetings through STT techniques, generates summaries and identifies the topics discussed automatically. The information generated from the transcripts is used to expand the knowledge base of the system.
- The virtual notary generates blockchain evidence of the most relevant events of the meetings , such as the start of a meeting or the casting of a vote. In addition, it generates evidence of its interactions with users and the information it generates (transcripts, summaries, etc.).
Initial objectives of the project
The objectives set at the beginning of the R+D project were:
- The design of the overall system architecture.
- Possibility of interaction with the Assistant through text and voice, offering answers on static knowledge bases (limited knowledge on a subset of Spanish legislation) and on dynamic knowledge bases (information relating to previous meetings).
- Improving the responsiveness of the Assistant in future interactions through continuous learning from user feedback.
- Interaction with the “virtual notary” through text and voice through a web interface executable in a browser.
- Transcription and audio processing of meetings by the Assistant, expanding their knowledge base.
- Generation of blockchain evidence of the main events of the meetings, audio, video, transcripts and other derived information, and of the notary’s interactions with users.
- Experimental prototype available for proof of concept.
Through NAVIRO, users of the final product will be able to access, in a fast, simple way and with electronic evidence, the resolution of doubts and the retrieval of information.
The assistant will be able to hold basic conversations, offer relevant information about previous meetings, and answer questions about a relevant subset of Spanish law.
The virtual notary will be able to be present as another listener in the meeting, generating a transcription of the meeting in the background and in an automated way. It will detect the most relevant topics of the meeting and generate a summary of it.
It will detect important events during the course of the meetings such as the start of the meetings, the opening of voting, the list of connected participants, etc. For this type of event, the notary will be in charge of generating blockchain evidence unattended and will sign it digitally. It will also generate evidence of its interactions with users and the information it generates automatically (transcripts, summaries, etc.).
All these innovative functionalities were not available at the time of starting the R+D project by any known system and implied a clear technological advance.
Lines of development
At the functional level, the smart virtual notary was a development with three different areas:
- Generating and processing transcripts
It brought together the artificial intelligence models necessary to carry out the transcription of the audio of the meetings in Spanish and to obtain information from them such as summaries and relevant topics. Additionally, digitally signed blockchain evidence was generated for all the information generated by this module (transcript, meeting topics and summaries).
- Text and voice interaction system
It is the module in charge of managing the conversation with the user for the retrieval of relevant information based on the context, interpretation and response to questions from a knowledge base.
Milestones achieved
Year 2022
Throughout 2022, the following results were achieved:
Analysis:
- Study of the state of the art on AI.
- Requirements of the global architecture, the healthcare system, the scalability of the global system and the transcription system.
- Preliminary description of the proof of concept.
Design:
- Choice of technologies for the construction of AI models and the assistant system.
- Design of the transcription generation and processing modules, the assistant system, the evidence generation and retrieval system.
- Scalable global architecture design.
First quarter of 2023
Throughout the first quarter of 2023, important milestones were reached:
Analysis:
- Complete study of different models to generate questions and answers in an automated way, even from the transcripts of the meetings, testing different alternatives such as Bloom or TF-IDF.
Design and development:
- Completion of the models that allow you to automatically obtain topics and keywords from what is discussed in the meetings.
- Start of work to be able to make the prototype necessary to carry out a proof of concept.
Q2 and Q3 2023
In the second and third quarters of 2023, the project was completed to have an experimental prototype of a Virtual Assistant, with notarization of events on Blockchain, including the interactions of the “Virtual Notary”.
At the end of the project, NAVIRO allows:
- Automatically transcribe recorded audio from a meeting to text.
- Generate a summary of the meeting.
- Generate a list of keywords for the meeting.
- Generate a list of key topics of the meeting.
- To search using natural language in databases of knowledge on Spanish legislation.
- Directly access articles of law related to searches.
To obtain this content, the user only needs to interact with the Assistant, in a web interface, giving spoken or written instructions.
Video demo (spanish)
Technological advances achieved
With the realization of this prototype, all the objectives set at the beginning of the project have been met, and a series of technological advances have been generated that can be applied in other environments:
- Preprocessing meeting transcripts.
- Audio-to-text transcription model adapted to the legaltech sector.
- Conversational system by text and voice, in a web interface.
- Automatic summary model.
- Word extraction model.
- Model for automatic generation of questions and answers.
- Thematic extraction model.
- Recording and accessing the evidence generated.
