{"id":53648,"date":"2021-03-16T15:12:19","date_gmt":"2021-03-16T09:42:19","guid":{"rendered":"https:\/\/www.tothenew.com\/blog\/?p=53648"},"modified":"2021-03-18T10:28:09","modified_gmt":"2021-03-18T04:58:09","slug":"simplified-aem-automation-with-curl-and-ruby","status":"publish","type":"post","link":"https:\/\/www.tothenew.com\/blog\/simplified-aem-automation-with-curl-and-ruby\/","title":{"rendered":"Simplified AEM Automation with cURL and RUBY"},"content":{"rendered":"

Administrators often need to automate or simplify common tasks within any system. In Adobe Experience Manager (AEM), managing users, installing packages, and managing OSGi bundles are some of the tasks where automation is commonly required.
\nBecause of the RESTful nature of the Sling framework upon which AEM is built, most of the tasks can be reduced to a URL call. cURL can be used to execute such URL calls and can be proved as a useful tool for automation inside an AEM environment.<\/p>\n

What is cURL?<\/b><\/h1>\n

cURL stands for Client for URL and is an open-source command-line tool used to perform URL manipulations. It supports a wide range of internet protocols including HTTP, HTTPS, FTP, FTPS, SCP, SFTP, TFTP, LDAP, DAP, DICT, TELNET, FILE, IMAP, POP3, SMTP, and RTSP.
\nOriginally released in 1997, cURL is a well-established and widely-used tool for providing or receiving data using the URL syntax.<\/p>\n

Installation<\/b><\/h1>\n

cURL comes by default in most of the systems, however, it can be downloaded and installed from the link here<\/a>.
\nWindows users need to ensure that they have appended the environment variable \u2018path\u2019 with the path of the bin where cURL is installed. The stepwise process is mentioned below.<\/p>\n

    \n
  1. Open the Start Search, type in \u201cenv\u201d, and choose \u201cEdit the system environment variables\u201d.<\/li>\n
  2. Click the \u201cEnvironment Variable\u201d button.<\/li>\n
  3. Under the \u201cSystem Variables\u201d section (the lower half), find the row with \u201cPath\u201d in the first column, and click edit.<\/li>\n
  4. The \u201cEdit environment variable\u201d UI will appear. Click on \u201cNew\u201d and type in the new path you want to add.<\/li>\n<\/ol>\n

     <\/p>\n

    cURL for AEM<\/b><\/h1>\n

    Since AEM follows REST architecture, cURL can execute most tasks using a URL call.
    \ncURL can be handy when it comes to content manipulation tasks such as activating pages, starting workflows and operational tasks such as package management and managing users. In addition you can create your own cURL commands for most of the tasks in AEM.
    \nThe official link for some common AEM cURL commands is     here<\/a>.
    \nA     cheat sheet<\/a> is also available for reference.<\/p>\n

    Building a cURL command for AEM<\/b><\/h1>\n

    cURL commands can be built for most operations in AEM such as triggering workflows, checking OSGi configurations, triggering JMX commands, creating replication agents, etc.
    \nTo find the exact command needed for a particular operation, use the developer tools in your browser to capture the POST call to the server when you perform the AEM operation manually.
    \nNow, let\u2019s see how to create the cURL command for giving path specific read\/modify access to a user.<\/p>\n

      \n
    1. Prepare the action you wish to invoke within AEM. In our case, we have proceeded to the \/useradmin page to manage users.
      \n\"1\"<\/li>\n
    2. Go to the developer console or Right click and select inspect and then go to the network tab.
      \n\"2\"<\/li>\n
    3. Select the permissions that you want to give to the user for the specified path and then click save. Here, we will proceed with read\/modify permissions for \/etc path (observe the POST call).
      \n\"3\"<\/li>\n
    4. Copy the URL from the POST call in the header section.
      \n\"4\"
      \nRequest payload from request section. This will be the data parameter for our cURL command.
      \n\"5\"<\/li>\n
    5. Execute the cURL command via command line and view the response.
      \n\"6\"
      \n\"7\"
      \n\"8\"<\/li>\n<\/ol>\n

      Moving beyond cURL<\/b><\/h1>\n

      Although cURL is the go-to tool for administration API testing in AEM and has a lot of documentation established around it, it has its flaws in terms of automation and dependency to shell. These flaws can create obstacles while writing server- independent and complex scripts.<\/p>\n

      Challenges with cURL<\/b><\/h1>\n
        \n
      • Inconsistent response payload types<\/b>
        \ncURL response types vary in terms of usage. This creates a lack of uniformity when writing scripts that utilize response payloads. As seen in the last example above, the response for updating permission was in HTML<\/b>.
        \nHowever, the response for activating an OSGi bundle, for example, is in JSON<\/b>.
        \n\"9\"
        \nAnd the response for listing packages in crx is in XML<\/b>.
        \n\"10\"<\/li>\n
      • Unreliable status codes<\/b>
        \nSome of the status codes that are returned as a response are occasionally unreliable. Here are some examples:<\/p>\n
          \n
        • http 200 with empty response body\u2028 when authentication is invalid<\/li>\n
        • http 200 with error message in html response body\u2028 when old password is incorrect<\/li>\n<\/ul>\n<\/li>\n
        • Serverless<\/b>
          \ncURL is dependent on access to shell and lacks integration with Serverless frameworks.<\/li>\n<\/ul>\n

          The Way Forward: OpenAPI (Swagger) for AEM<\/b><\/h1>\n

          Swagger AEM is an OpenAPI specification for Adobe Experience Manager, which can be used to generate API clients in 30 programming languages.
          \nThese API clients, in turn, are useful for integrating AEM with a number of technology stacks. From setting OSGI configuration using provisioning tools such as Puppet, to deploying AEM packages using voice via Google Assistant. The possibilities are endless. Ruby_aem<\/b> is one option that can solve the cURL AEM challenges.<\/p>\n

          What makes Ruby_aem a viable solution?<\/b><\/h1>\n
            \n
          1. Resource Oriented Design<\/li>\n
          2. Further abstraction away from endpoints<\/li>\n
          3. Error and response objects<\/li>\n
          4. Additional custom APIs<\/li>\n<\/ol>\n

            Installation<\/h1>\n

            The steps are illustrated below.
            \n\"11\"<\/p>\n

            Result Handling<\/h1>\n

            Ruby_aem allows for much better result handling due to its uniform response payloads which are parsed beforehand. Also, it is endpoint free.
            \n\"12\"<\/p>\n

            Error Handling<\/h1>\n

            Better error and edge case handling allows us to write more robust scripts. Additionally, unlike cURL, ruby is a first class programming language which gives us much more flexibility and freedom.
            \n\"13\"<\/p>\n

            Serverless<\/h1>\n

            Ruby_aem is only part of the available client library support for Swagger_aem. Swagger_aem also houses support for java, python and javascript for AEM. This allows us to move forward from the dependency on shell.<\/p>\n

            Key Features of Ruby_aem<\/b><\/h1>\n
              \n
            • Wait until login page is ready<\/li>\n
            • Wait until AEM health check is passed<\/li>\n
            • Bundle start, stop<\/li>\n
            • Con\ufb01guration property create<\/li>\n
            • Replication, reverse replication, and \ufb02ush agents create, update, delete<\/li>\n
            • User and group create and delete<\/li>\n
            • Add user and group to a group<\/li>\n
            • Node create and delete<\/li>\n
            • Package create, update, delete, upload, install, uninstall, replicate, list, versions<\/li>\n
            • Path activate<\/li>\n
            • Repository block, unblock<\/li>\n<\/ul>\n

               <\/p>\n

              Conclusion<\/b><\/h1>\n

              All in all, cURL and Ruby_aem both have their uses in AEM. Although cURL is a much easier tool to pick up on the go and use for testing out APIs or hitting URLs, it is still lacking in some areas. For complex automation, Ruby_aem provides a more comprehensive pool of utilities.<\/p>\n","protected":false},"excerpt":{"rendered":"

              Administrators often need to automate or simplify common tasks within any system. In Adobe Experience Manager (AEM), managing users, installing packages, and managing OSGi bundles are some of the tasks where automation is commonly required. Because of the RESTful nature of the Sling framework upon which AEM is built, most of the tasks can be […]<\/p>\n","protected":false},"author":1234,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":90},"categories":[3887,3109],"tags":[3598,4858],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/53648"}],"collection":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/users\/1234"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/comments?post=53648"}],"version-history":[{"count":4,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/53648\/revisions"}],"predecessor-version":[{"id":53668,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/53648\/revisions\/53668"}],"wp:attachment":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/media?parent=53648"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/categories?post=53648"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/tags?post=53648"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}