Introduction to Big Data


Big Data is an extremely large data set consisting of both structured and unstructured data. It has high volume, velocity and variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making. These days the amount of data has increased in a huge amount, which has formed this Big Data.

The data in an organization these days are is growing beyond MBs, or TBs, or GBs. The point is about, what if the data is growing more than that is present today. The future may see the data growing to about Petabyte(1024 TB) or Exabyte(1024 PB) or Zettabyte(1024 EB) or Yottabyte(1024 ZB).

Some of the data facts are that the New York stock exchange generates about 1 Terabyte of data per day, Facebook hosts approximately 10 billion photos, making up to about one Petabyte of data, 8 TB of data is generated by Twitter.

To most the Big Data is not just about the size of the data, but also the 4V’s of data. While the volume of data is one of the aspects of the Big Data, it also includes the variety of data and the velocity at which the data is coming into the organization and also about the value of the data to the organization. The value is very important for any organization. Hence it is actually summarized as 4V’s of data : Volume, Velocity, Variety, Value.

Processing of this Big Data needs a platform to organize the data and process it properly. Hadoop is that platform which helps in organizing and processing the Big Data, which has it’s origins in Apache Nutch.

At RailsCarma we have been successfully using Hadoop to organize, large volumes of data for our clients and we would be sharing our experiences and learning’s in our upcoming blogs. So keep tuned.

Source : RailsCarma

Advertisements

Real-time Framework


blog_b2_thumb

Real-time’s Framework is a blindingly fast bi-directional persistently connected messaging system. It’s a unique means for a company to conduct a live online relationship with clients.

This has the massive advantage of allowing interaction to happen live in real-time, without delays or page refreshes, to create a durable and bidirectional relationship with each online user.

It works with two main components:

Enabling the live web is ORTC (Open Real-time Connectivity): A secure, fast and highly scalable cloud-hosted real-time many-to-many messaging system for web and mobile apps.

Here we can use ORTC client instead of xRTML code snippet provided by realtime.co for real-timeconnections.

The language of the Live Web s xRTML (Extensible Realtime Multiplatform Language): A set of api tools to build realtime web and mobile apps with an easy to use API based on a JavaScript library.

Steps:
Include this js plugin http://dfdbz2tdq3k01.cloudfront.net/js/2.1.0/ortc.js

For Sending Messages to Realtime:

window.onload = function () {

   loadOrtcFactory(IbtRealTimeSJType, function (factory, error) {

       if (error != null) {

           alert(“Factory error: ” + error.message);

       } else {

           if (factory != null) {

               // Create ORTC client

               var ortcClient = factory.createClient();

               // Set ORTC client properties

               ortcClient.setId(‘clientId’);

               ortcClient.setConnectionMetadata(‘clientConnMeta’);

               ortcClient.setClusterUrl(‘http://ortc-developers.realtime.co/server/2.1/‘);

               ortcClient.onConnected = function (ortc) {

                    // Connected
// First Channel

                   ortcClient.subscribe(‘channel1′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

// Second Channel

                   ortcClient.subscribe(‘channel2′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

               };

               ortcClient.onDisconnected = function (ortc) {

                    // Disconnected

               };
//Send your messages here

               ortcClient.onSubscribed = function (ortc, channel) {

                   // Subscribed to the channel ‘channel’);

                   ortcClient.send(channel, ‘Message to the channel’);

               };

               ortcClient.onUnsubscribed = function (ortc, channel) {

                   // Unsubscribed from the channel ‘channel’);

                   ortcClient.disconnect();

               };

                ortcClient.onException = function (ortc, exception) {

                    // Exception occurred: ‘exception’

               };

                ortcClient.onReconnecting = function (ortc) {

                    // Trying to reconnect

               };

                ortcClient.onReconnected = function (ortc) {

                    // Reconnected

               };

                           ortcClient.connect(‘myApplicationKey’, ‘myAuthenticationToken’);

            }

        }

    });

};

For Receiving Messages from Realtime to App Frontend:
//Here remove ortcClient.onSubscribed function

window.onload = function () {

   loadOrtcFactory(IbtRealTimeSJType, function (factory, error) {

       if (error != null) {

           alert(“Factory error: ” + error.message);

       } else {

           if (factory != null) {

               // Create ORTC client

               var ortcClient = factory.createClient();

               // Set ORTC client properties

               ortcClient.setId(‘clientId’);

               ortcClient.setConnectionMetadata(‘clientConnMeta’);

               ortcClient.setClusterUrl(‘http://ortc-developers.realtime.co/server/2.1/‘);

               ortcClient.onConnected = function (ortc) {

                    // Connected
// First Channel

                   ortcClient.subscribe(‘channel1′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

// Second Channel

                   ortcClient.subscribe(‘channel2′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

               };

               ortcClient.onDisconnected = function (ortc) {

                    // Disconnected

               }

               ortcClient.onUnsubscribed = function (ortc, channel) {

                   // Unsubscribed from the channel ‘channel’);

                   ortcClient.disconnect();

               };

                ortcClient.onException = function (ortc, exception) {

                    // Exception occurred: ‘exception’

               };

                ortcClient.onReconnecting = function (ortc) {

                    // Trying to reconnect

               };

                ortcClient.onReconnected = function (ortc) {

                    // Reconnected

               };

                ortcClient.connect(‘myApplicationKey’, ‘myAuthenticationToken’);

            }

        }

    });

};

Conclusive Note:

The Real-time framework is henceforth an emerging and fast growing messaging system which helps the business to serve their clients at a very speedy rate and hence also avoid the time gap of providing the services.

This also gives a competitive advantage to the business, as it is the system, that is suitable for today’s recurrently growing world of business.

Source : RailsCarma

Real-time Framework


Real-time’s Framework is a blindingly fast bi-directional persistently connected messaging system. It’s a unique means for a company to conduct a live online relationship with clients.

This has the massive advantage of allowing interaction to happen live in real-time, without delays or page refreshes, to create a durable and bidirectional relationship with each online user.

It works with two main components:

Enabling the live web is ORTC (Open Real-time Connectivity): A secure, fast and highly scalable cloud-hosted real-time many-to-many messaging system for web and mobile apps.

Here we can use ORTC client instead of xRTML code snippet provided by realtime.co for real-timeconnections.

The language of the Live Web s xRTML (Extensible Realtime Multiplatform Language): A set of api tools to build realtime web and mobile apps with an easy to use API based on a JavaScript library.
blog_b2_thumb

Steps:
Include this js plugin http://dfdbz2tdq3k01.cloudfront.net/js/2.1.0/ortc.js

For Sending Messages to Realtime:

window.onload = function () {

   loadOrtcFactory(IbtRealTimeSJType, function (factory, error) {

       if (error != null) {

           alert(“Factory error: ” + error.message);

       } else {

           if (factory != null) {

               // Create ORTC client

               var ortcClient = factory.createClient();

               // Set ORTC client properties

               ortcClient.setId(‘clientId’);

               ortcClient.setConnectionMetadata(‘clientConnMeta’);

               ortcClient.setClusterUrl(‘http://ortc-developers.realtime.co/server/2.1/‘);

               ortcClient.onConnected = function (ortc) {

                    // Connected
// First Channel

                   ortcClient.subscribe(‘channel1′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

// Second Channel

                   ortcClient.subscribe(‘channel2′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

               };

               ortcClient.onDisconnected = function (ortc) {

                    // Disconnected

               };
//Send your messages here

               ortcClient.onSubscribed = function (ortc, channel) {

                   // Subscribed to the channel ‘channel’);

                   ortcClient.send(channel, ‘Message to the channel’);

               };

               ortcClient.onUnsubscribed = function (ortc, channel) {

                   // Unsubscribed from the channel ‘channel’);

                   ortcClient.disconnect();

               };

                ortcClient.onException = function (ortc, exception) {

                    // Exception occurred: ‘exception’

               };

                ortcClient.onReconnecting = function (ortc) {

                    // Trying to reconnect

               };

                ortcClient.onReconnected = function (ortc) {

                    // Reconnected

               };

                           ortcClient.connect(‘myApplicationKey’, ‘myAuthenticationToken’);

            }

        }

    });

};

For Receiving Messages from Realtime to App Frontend:
//Here remove ortcClient.onSubscribed function

window.onload = function () {

   loadOrtcFactory(IbtRealTimeSJType, function (factory, error) {

       if (error != null) {

           alert(“Factory error: ” + error.message);

       } else {

           if (factory != null) {

               // Create ORTC client

               var ortcClient = factory.createClient();

               // Set ORTC client properties

               ortcClient.setId(‘clientId’);

               ortcClient.setConnectionMetadata(‘clientConnMeta’);

               ortcClient.setClusterUrl(‘http://ortc-developers.realtime.co/server/2.1/‘);

               ortcClient.onConnected = function (ortc) {

                    // Connected
// First Channel

                   ortcClient.subscribe(‘channel1′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

// Second Channel

                   ortcClient.subscribe(‘channel2′, true, function (ortc, channel, message) {

                        console.log(message)

                       ortcClient.unsubscribe(channel);

                   });

               };

               ortcClient.onDisconnected = function (ortc) {

                    // Disconnected

               }

               ortcClient.onUnsubscribed = function (ortc, channel) {

                   // Unsubscribed from the channel ‘channel’);

                   ortcClient.disconnect();

               };

                ortcClient.onException = function (ortc, exception) {

                    // Exception occurred: ‘exception’

               };

                ortcClient.onReconnecting = function (ortc) {

                    // Trying to reconnect

               };

                ortcClient.onReconnected = function (ortc) {

                    // Reconnected

               };

                ortcClient.connect(‘myApplicationKey’, ‘myAuthenticationToken’);

            }

        }

    });

};

Conclusive Note:

The Real-time framework is henceforth an emerging and fast growing messaging system which helps the business to serve their clients at a very speedy rate and hence also avoid the time gap of providing the services.

This also gives a competitive advantage to the business, as it is the system, that is suitable for today’s recurrently growing world of business.

Source : RailsCarma