Tag Archives: Latency

Big Data, Java

Problem We had a use case where we needed to use machine learning to make predictions in real time. To give an estimate of what we consider real time - latency less than 10 milliseconds for our predictions. In this blog, we would discuss what is needed to have the kind of latency for machine learning models that we can use in production....