Skip to main content

When Will Amazon Zocalo Get An API?

I was among the thousands of attendees of yesterday's Amazon AWS Summit in New York. One of the key services announced was Zocalo, a file storage and sharing service for the enterprise.

One aspect of the Zocalo service that wasn't clear is whether it will have an API. Part of the system I am currently working on provides a workflow for analysts to work with small sets of files. An API for Zocalo would allow automated process and analysts to jointly curate the files.

Other AWS services have great API's: I've especially enjoyed working with the Java libraries for AWS services. Amazon usually takes API development very seriously and produces solid interfaces. Interoperating Zocalo with other AWS services would be the killer feature for my current use case, and an API with good libraries would facilitate this.

Here are some ideas for what could be done combining Zocalo and other AWS services:

  • Analyze file access and update logs using EMR or Kinesis. This could reveal suspicious access patterns associated with loss of IP, or it could be used to run a cluster analysis of users to identify ad-hoc groups that are collaborating on content.
  • Build content-based workflows. Workflows that depend on file data could be built on top of Zocalo. This allows easy ad-hoc access to the data, while also enabling systems where the data is modified by automated processes or external systems. For example, new versions could automatically trigger review from a quality assurance group.
  • Find trending topics in documents. If new versions could be fed into Amazon Kinesis, it would be possible for the system to identify trending keywords or phrases in real time. Data could be fed into Redshift and shown to editors or management.
  • Manage users and security automatically. For example, when a new user is provisioned in ActiveDirectory then the onboarding system could trigger the user to be added to Zocalo and could grant appropriate access rights.
I'm sure there are many other interesting things that can be done through an API integration, maybe even capabilities provided by outside vendors that expands the partner network concept. Zocalo is an exiting offering as-is, but with an API the possibilities are multiplied.



Labels:

Comments

  1. SuvojyotyOctober 7, 2014 at 7:19 AM

    Hi Greg,

    I had some questions regarding Amazon Zocalo. It would be very helpful if you share your thoughts on the same.
    1. Can I restrict Users from uploading files of a particular name or extension? (Ex. I want users not to upload *.exe files)
    2. Can I keep files in Amazon Zocalo for eternity? If not how long?
    3. Is White labelling enabled for Amazon Zocalo?
    4. Is there any guarantee which Amazon Zocalo provides for stored documents by various users?

    Thanks
    Suvojyoty

    ReplyDelete
    Replies
    1. Greg LeibOctober 7, 2014 at 10:49 AM

      Thanks for your comment. I haven't spent much time looking into Zocalo since this post. After looking at the pricing and capabilities, my team decided to stick with S3 storage for our data processing system. We certainly wouldn't have been typical Zocalo users had we switched over.

      For answers to your specific questions, I strongly suggest you ask them on the Zocalo AWS forum:

      https://forums.aws.amazon.com/forum.jspa?forumID=172

      Delete
    2. SuvojyotyOctober 8, 2014 at 1:18 AM

      Thanks for the prompt reply Greg.

      Delete

Post a Comment

Popular posts from this blog

ReactJS, NPM and Maven

I'm just starting to get into working with ReactJS, Facebook's open source rendering framework. My project uses SpringBoot for annotation-driven dependency injection and MVC. I thought it would be great if I could use a bit of ReactJS to enhance the application. If you're looking for a basic conceptual intro, I recommend ReactJS for Stupid People and of course the official documentation  is quite good. In full disclosure, I still have no idea how to do "flux" yet. As an experienced Java backend developer, I'm pretty decent at hacking Maven builds - which is precisely what this blog post is going to be about. First, a word about how React likes to be built. Like many front-end tools, there is a toolkit for the node package manager (NPM). From the command prompt, one might run npm install -g react-tools  which installs the jsx command. The  jsx  command provides the ability to transform JSX syntax into ordinary JavaScript, which is precisely what I want...
21 comments
Read more

Cryptic Facebook Message

Facebook OAuth2 is a feature I frequently integrate, but sometimes its error messages can be downright opaque. In particular I keep on forgetting to associate my Facebook account on applications where Sandbox Mode is enabled. The error message in this case is the following: Sorry, this feature isn't available right now: An error occurred while processing this request. Please try again later. This message is super cryptic, since what I usually need to do is to register my account as a tester or admin on the Facebook application page. If you get this error message here are the steps to fix it: As an application administrator, go to the OAuth2 configuration page for the application in Facebook. Add the Facebook account as an admin or tester on the "edit roles" screen. This will send an application request to that account. As the added account, accept the application request to become an admin or tester. At this point the Facebook login should work for the accou...
1 comment
Read more

Generating a Self-Signed SSL Certificate

I recently switched some web services to use SSL, and I was surprised that I couldn't find a good non-interactive script to generate the files needed for Jetty and other Java containers. After working my way through writing the script, I have decided to share my approach. This script generates a SSL subdirectory of whatever folder it lives in, and to that directory it adds a password file, certificate and a Java-friendly PKCS12 version of the certificate. And then I have my Maven build process copy the generated files into the base of my classes directory. The embedded Jetty instance needed an input stream of the PKCS12 file and the contents of the password file to create a SSL connector. Reading from the classpath can be a bit tricky - I should post about that later. From past experience, I think Nginx also requires the certificate file when configuring SSL.
Post a Comment
Read more