taiwotman/tmlink repository overview

Description:

Probabilistic linkage has revolutionized the process of associating records across diverse data sources. Building on this foundation, transformer models – renowned for their success in natural language processing – offer a promising approach to enhancing probabilistic linkage. By harnessing contextual embeddings and attention mechanisms, transformer models can significantly improve record association accuracy.

Our innovative TMLink SmartApp seamlessly integrates probabilistic linkage with transformer models, ensuring reliable and accurate record matching. Leveraging Streamlit for intuitive frontend operations and a robust API for backend processes, this app provides an efficient solution for complex data-matching tasks.

Author: Taiwo O. Adetiloye, PhD⁠.

Medium blog: Unveiling the Magic of Probabilistic Record Linkage with Transformer Models in Three Stages⁠.

Website: https://tmlink.ai⁠

Important notice: This is a trial version. To customize, please contact us⁠.

Our tests have been done using RLData500⁠, RLData10000⁠, Febrl⁠ datasets.

Set up:

Pull docker image

docker pull taiwotman/tmlink:latest

Run the Docker Container

docker run -d -p 8501:8501 taiwotman/tmlink

NOTE: It takes about 5 mins to complete the software installation...please wait.

Open app on browser:

http://localhost:8501⁠

Run into an issue due to disk space? Clean up your Docker environment by removing unused resources using:

docker system prune

Software perpetual license agreement:

• Grant of License: The Licensor hereby grants the Licensee a perpetual, non-exclusive, non-transferable license to use the Software, subject to the terms of this Agreement.

• Payment: The Licensee agrees to pay a one-time fee which shall be agreed upon for the perpetual use of the Software.

• Term and Renewal: This License shall be perpetual but renewable annually upon mutual agreement of both parties. Renewal is subject to an annual fee, which shall be agreed upon each renewal term.

• Limitation of Liability: The Licensor shall not be liable for any damages arising out of or in connection with the use or inability to use the Software, including but not limited to direct, indirect, incidental, punitive, and consequential damages.

• Governing Law: This Agreement shall be governed by and construed in accordance with the laws of Jurisdiction of Country of Use.

• Entire Agreement: This Agreement constitutes the entire agreement between the parties concerning the subject matter hereof and supersedes all prior and contemporaneous agreements, understandings, negotiations, and discussions, whether oral or written.

• Severability: If any provision of this Agreement is found to be invalid or unenforceable, the remaining provisions shall continue in full force and effect.

• Amendments: Any amendments or modifications to this Agreement must be in writing and signed by both parties.

References:

1. Borg, A., & Sariyar, M. (2022). RLdata: Test data for Record Linkage. RecordLinkage: Record Linkage Functions for Linking and Deduplicating Data Sets. Available from: RLData500 & RLData 10000 Datasets⁠.

2. Christen, P. (2008). Febrl - A Freely Available Record Linkage System with a Graphical User Interface. Proceedings of the Australasian Workshop on Health Data and Knowledge Management (HDKM), Conferences in Research and Practice in Information Technology (CRPIT), vol. 80. Wollongong, Australia, January 2008. Available from: Febrl Datasets⁠

3. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L, Gomez, A.N, Kaiser, Ł., Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems. Available from: Conference on Neural Information Processing Systems Proceedings⁠