Latest News

    • Web Services Architecture – When to Use SOAP vs REST

      SOAP (Simple Object Access Protocol) and REST (Representation State Transfer) are popular with developers working on system integration based projects. Software architects will design the application from various perspectives and also decides, based on various reasons, which approach to take to expose new API to third party applications. As a software architect, it is good practice to involve your development team lead during system architecture process.   This article, based on my experience, will discuss when to use SOAP or REST web services to expose your API to third party clients.   Web Services Demystified Web services are part of the Services Oriented Architecture. Web services are used as the model for process decomposition and assembly. I have been involved in discussion where there were some misconception between web services and web API.   The W3C defines a Web Service generally as:   A software system designed to support interoperable machine-to-machine interaction over a network.   Web API also known as Server-Side Web API is a programmatic interface to a defined request-response message system, typically expressed in JSON or XML, which is exposed via the web – most commonly by means of an HTTP-based web server. (extracted from Wikipedia)   Based on the above definition, one can insinuate when SOAP should be used instead of REST and vice-versa but it is not as simple as it looks. We can agree that Web Services are not the same as Web API. Accessing an image over the web is not calling a web service but retrieving a web resources using is Universal Resource Identifier. HTML has a well-defined standard approach to serving resources to clients and does not require the use of web service in order to fulfill their request.   Why Use REST over SOAP Developers are passionate people. Let's briefly analyze some of the reasons they mentioned when considering REST over SOAP:   REST is easier than SOAP I'm not sure what developers refer to when they argue that REST is easier than SOAP. Based on my experience, depending on the requirement, developing REST services can quickly become very complex just as any other SOA projects. What is your service abstracting from the client? What is the level of security required? Is your service a long running asynchronous process? And many other requirements will increase the level of complexity. Testability: apparently it easier to test RESTFul web services than their SOAP counter parts. This is only partially true; for simple REST services, developers only have to point their browser to the service endpoints and a result would be returned in the response. But what happens once you need to add the HTTP headers and passing of tokens, parameters validation… This is still testable but chances are you will require a plugin for your browser in order to test those features. If a plugin is required then the ease of testing is exactly the same as using SOAPUI for testing SOAP based services.   RESTFul Web Services serves JSON that is faster to parse than XML This so called "benefit" is related to consuming web services in a browser. RESTFul web services can also serve XML and any MIME type that you desire. This article is not focused on discussing JSON vs XML; and I wouldn't write any separate article on the topic. JSON relates to JavaScript and as JS is very closed to the web, as in providing interaction on the web with HTML and CSS, most developers automatically assumes that it also linked to interacting with RESTFul web services. If you didn't know before, I'm sure that you can guess that RESTFul web services are language agnostic. Regarding the speed in processing the XML markup as opposed to JSON, a performance test conducted by David Lead, Lead Engineer at MarkLogic Inc, find out to be a myth.   REST is built for the Web Well this is true according to Roy Fielding dissertation; after all he is credited with the creation of REST style architecture. REST, unlike SOAP, uses the underlying technology for transport and communication between clients and servers. The architecture style is optimized for the modern web architecture. The web has outgrown is initial requirements and this can be seen through HTML5 and web sockets standardization. The web has become a platform on its own right, maybe WebOS. Some applications will require server-side state saving such as financial applications to e-commerce.   Caching When using REST over HTTP, it will utilize the features available in HTTP such as caching, security in terms of TLS and authentication. Architects know that dynamic resources should not be cached. Let's discuss this with an example; we have a RESTFul web service to serve us some stock quotes when provided with a stock ticker. Stock quotes changes per milliseconds, if we make a request for BARC (Barclays Bank), there is a chance that the quote that we have receive a minute ago would be different in two minutes. This shows that we cannot always use the caching features implemented in the protocol. HTTP Caching be useful in client requests of static content but if the caching feature of HTTP is not enough for your requirements, then you should also evaluate SOAP as you will be building your own cache either way not relying on the protocol.   HTTP Verb Binding HTTP verb binding is supposedly a feature worth discussing when comparing REST vs SOAP. Much of public facing API referred to as RESTFul are more REST-like and do not implement all HTTP verb in the manner they are supposed to. For example; when creating new resources, most developers use POST instead of PUT. Even deleting resources are sent through POST request instead of DELETE.   SOAP also defines a binding to the HTTP protocol. When binding to HTTP, all SOAP requests are sent through POST request.   Security Security is never mentioned when discussing the benefits of REST over SOAP. Two simples security is provided on the HTTP protocol layer such as basic authentication and communication encryption through TLS. SOAP security is well standardized through WS-SECURITY. HTTP is not secured, as seen in the news all the time, therefore web services relying on the protocol needs to implement their own rigorous security. Security goes beyond simple authentication and confidentiality, and also includes authorization and integrity. When it comes to ease of implementation, I believe that SOAP is that at the forefront.   Conclusion This was meant to be a short blog post but it seems we got to passionate about the subject.   I accept that there are many other factors to consider when choosing SOAP vs REST but I will over simplify it here. For machine-to-machine communications such as business processing with BPEL, transaction security and integrity, I suggest using SOAP. SOAP binding to HTTP is possible and XML parsing is not noticeably slower than JSON on the browser. For building public facing API, REST is not the undisputed champion. Consider the actual application requirements and evaluate the benefits. People would say that REST protocol agnostic and work on anything that has URI is beside the point. According to its creator, REST was conceived for the evolution of the web. Most so-called RESTFul web services available on the internet are more truly REST-like as they do not follow the principle of the architectural style. One good thing about working with REST is that application do not need a service contract a la SOAP (WSDL). WADL was never standardized and I do not believe that developers would implement it. I remember looking for Twitter WADL to integrate it.   I will leave you to make your own conclusion. There is so much I can write in a blog post. Feel free to leave any comments to keep the discussion going.

Monday, 20 April 2009

The Anatomy of Twitter Automated Mass Direct Message

So Twitter is the new web phenomenon and it is still shy of its third birthday. Since it has come to the scene, we had heard much about it in the media; about its popularity and security breach. So what is twitter? This is how I define it:

  1. It is a social (networking) site J where users can send short messages to each other in the same manner as SMS (short message service) and mainly targeted to the mobile market; but a lot of people still use the web to twit messages including myself.
  2. It is a "PUSH" application where when a user publishes a message all the registered interested parties will automatically receive a copy' this is almost similar to RSS feeds. When using the Application Programming Interface to develop third-party client, it then becomes a "PULL" based broadcasting system.
  3. It is also a marketer best friend ( but I do not see how Twitter as a company can monetize on it), people on Twitter are more likely to click on a URL link, due to the fact that only 160 characters are allowed, either by curiosity or in hope to find out more about the subject of the twit.

The popularity of Twitter is a funny one. When the web first surfaced, technologists were discussing its lack of multimedia and its static type, then came Youtube and Facebook among others. Twitter on the other hand is based on text and that's all! Takes much of its features from SMS but it does not even allow for smillies L
J but I am sure that they are probably working on that and hopefully it will not cause any problems to Twitter current internal commands.

Anyway getting back to the subject at hand (see blog title), let me explain how to implement automated direct messages on the Twitter platform.

Twitter has some cool functionalities but it has a lot of restrictions. First, there are two types of messages available on the platform:

  1. Public Messages – this type of messages can be viewed by anyone with an account on twitter.
  2. Direct Messages – these messages are private messages that you send to people and hidden from the public stream. They are a good of making sure that the recipients notices (not sure they will read it but that's a start).

The platform allows you to monitor (tracking) words in the public stream which is very useful if you are running an automated Mass Direct Message campaign. So how does the mass message works?

  1. You can only send DM to people who are friends define by Twitter as:
    1. Friends are those who follow you and reciprocal meaning you need to be following them as well.
  2. Mentions and Replies messages are very useful for automated messages and will be of greater value if you do not have many friends.


To have an automated mass Direct Message, you need to do the following:

  1. Setup a (ro)bot which tracks certain words on twitter.
  2. Every time a track word is flagged, the bot should send a public reply to the originator.
    1. A public reply will make your message available in the public stream.
    2. A mention of the message originator will bring your message to his attention thus a very good marketing tool.
  3. Use a bot to send a DM messages to all your followers to make sure that they have a look at what you have to say.


Nothing is guarantee but when I run a test for a friend online shop, he was getting at least 100 visitors a day when he usually only gets about that a month or so. They are tools that can do the job but there is a chance of you getting banned by Twitter.

I have written a working prototype in JAVA, so it should be able to run on any platform, get in touch with me for a copy. It is free but I do not want to post it online in case it against the Twitter terms and conditions. You can also DM me on @armelnene.



  • Blogger Comments
  • Facebook Comments

0 comments :

Post a Comment

Item Reviewed: The Anatomy of Twitter Automated Mass Direct Message Description: Rating: 5 Reviewed By: Unknown