Efficient stream analysis and its application to big data processing