{"id":45957,"date":"2017-02-14T17:04:06","date_gmt":"2017-02-14T11:34:06","guid":{"rendered":"http:\/\/www.tothenew.com\/blog\/?p=45957"},"modified":"2017-02-14T17:04:06","modified_gmt":"2017-02-14T11:34:06","slug":"how-to-implement-queue-workerapi-in-drupal-8","status":"publish","type":"post","link":"https:\/\/www.tothenew.com\/blog\/how-to-implement-queue-workerapi-in-drupal-8\/","title":{"rendered":"How to implement Queue Worker\/API in Drupal 8?"},"content":{"rendered":"

Before I start my writing about Queue Worker, it is important to understand about cron job in Drupal<\/a> 8.<\/p>\n

In generic terms, cron is a scheduled job which runs periodically at fixed intervals. cron manages typical tasks such as database maintenance, sending bulk emails, fetching data from a\u00a0third-party on regular basis.<\/p>\n

It manages short running tasks with fewer resources and it will automatically time-out while performing\u00a0time-consuming tasks such as fetching data from a\u00a0third- party.<\/p>\n

In Drupal you can write cron like:-<\/p>\n

[php]<\/p>\n

function hook_cron() {
\n\u00a0 \/\/code.
\n}<\/p>\n

[\/php]<\/p>\n

in .module file of your module.<\/p>\n

So let’s take an example:-
\nThere is a module namely – my_module.
\nso in my_module.module file write<\/p>\n

[php]<\/p>\n

function my_module_cron() {
\n $mailManager = \\Drupal::service(‘plugin.manager.mail’);
\n $mailManager->mail($module, $key, $to, $langcode, $params = array(), $reply = NULL, $send = TRUE);
\n}<\/p>\n

\/**
\n * Implements hook_mail().
\n *\/
\nfunction my_module_mail($key, &$message, $params) {
\n switch ($key) {
\n case ‘key’:
\n $message[‘subject’] = t(‘Test’);
\n $message[‘body’][] = ‘Hello World!’;
\n break;
\n }
\n}<\/p>\n

[\/php]<\/p>\n

Whenever cron is executed it will send an email.<\/p>\n

drush commands to run a cron manually.<\/p>\n

drush core-cron<\/p>\n

alias<\/p>\n

drush cron<\/p>\n

Disadvantages:-<\/strong><\/p>\n

    \n
  1. You can not run an individual cron.<\/li>\n
  2. All hook_cron runs at same time for all modules according to module weight
    \nQueue Worker A Powerful manual cron system.<\/li>\n
  3. When\u00a0cron fails for a\u00a0module, the other cron of different modules will be not executed.<\/li>\n
  4. There is no logging information that can tell us which module was the culprit for cron failure.<\/li>\n
  5. Cron can’t handle large and complex tasks in huge quantity.<\/li>\n
  6. You can’t run cron with time limits.<\/li>\n<\/ol>\n

    QueueWorker:-<\/strong><\/p>\n

    The following disadvantages compel us to use queue API of Drupal 8 which is known as Queue Worker.<\/p>\n

    Queue Worker offers a lot of advantages such <\/span>as :<\/p>\n

      \n
    1. Offers flexibility to run queue with time limits<\/li>\n
    2. You can individual queue at one time as compared to cron which runs all the cron<\/li>\n
    3. Efficient as compared to cron, can handle resource intensive tasks<\/li>\n
    4. If any\u00a0failure occurs, you can revert the item\u00a0back to queue to process that again<\/li>\n
    5. Multiple queues can run without interrupting other work<\/li>\n
    6. You can log for each item of queue easily<\/li>\n<\/ol>\n

      Queue Worker rules out the disadvantage of hook_cron and hence solve the issues with hook cron very efficiently.<\/p>\n

      Here are some of the basics concepts of Queue API along with an example:<\/p>\n

      The Queue API in Drupal allows you to complete tasks at a\u00a0later stage. We can insert items in the queue and process them when we require. We can run Queue either by running cron or by manually using Drush commands.<\/p>\n

      Some very basic concepts of Queue working is\u00a0FIFO.<\/p>\n

      Components of Queue API.<\/p>\n

        \n
      1. QueueInterface<\/strong>:-\n
          \n
        • It plays a very important role here. Its implementation represents queue, which means the object of a class that implements\u00a0QueueInterface.<\/li>\n<\/ul>\n<\/li>\n
        • DatabaseQueue<\/strong>:-\n
            \n
          • It is a reliable type of queue which\u00a0makes ensure that it does not timeout. All the items are processed without any error and in (FIFO) order.<\/li>\n<\/ul>\n<\/li>\n
          • Roles of Queue Object<\/strong>:-\n
              \n
            • The typical role of the queue object is to create items, claim them from the queue and delete them when they have been processed.<\/li>\n
            • You can also release the items if processing is not finished or another Queue\u00a0needs to be processed before removing them from Queue.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n

              Here’s an example of Queue Worker.<\/p>\n

              You have a user query form on your website. See the attached screenshot of Form.\u00a0So, whenever a\u00a0<\/span>user submits a query instead of sending mail at run-time we will store these details in Queue Worker and later run Queue Worker manually whenever we want to receive emails.<\/span><\/p>\n

              Folder Structure. See attached screenshot.<\/p>\n

              \"1\"<\/p>\n

              my_module.info.yml<\/p>\n

              [php]<\/p>\n

              name: My Module
              \ndescription: ‘Example how to use Queue Worker’
              \npackage: Custom
              \ntype: module
              \ncore: 8.x<\/p>\n

              [\/php]<\/p>\n

              my_module.routing.yml<\/p>\n

              [php]<\/p>\n

              my_module.query_form:
              \n path: ‘\/user-query-form’
              \n defaults:
              \n _form: ‘\\Drupal\\my_module\\Form\\UserQueryForm’
              \n _title: ‘Query Form’
              \n requirements:
              \n _permission: ‘access content’<\/p>\n

              [\/php]<\/p>\n

              UserQueryForm.php<\/p>\n

              Screenshot:<\/p>\n

              \"form\"<\/p>\n

              Code:-<\/p>\n

              [php]<\/p>\n

              <?php<\/p>\n

              namespace Drupal\\my_module\\Form;<\/p>\n

              use Drupal\\Core\\Form\\FormBase;
              \nuse Drupal\\Core\\Form\\FormStateInterface;<\/p>\n

              \/**
              \n * Class UserQueryForm.
              \n *
              \n * @package Drupal\\my_module\\Form
              \n *\/
              \nclass UserQueryForm extends FormBase {<\/p>\n

              \/**
              \n * {@inheritdoc}
              \n *\/
              \n public function getFormId() {
              \n return ‘user_query_form’;
              \n }<\/p>\n

              \/**
              \n * {@inheritdoc}
              \n *\/
              \n public function buildForm(array $form, FormStateInterface $form_state) {
              \n $form[‘name’] = [
              \n ‘#type’ => ‘textfield’,
              \n ‘#attributes’ => [
              \n ‘placeholder’ => ‘Username’,
              \n ],
              \n ‘#required’ => true,
              \n ];
              \n $form[’email’] = [
              \n ‘#type’ => ’email’,
              \n ‘#attributes’ => [
              \n ‘placeholder’ => ‘Email’,
              \n ],
              \n ‘#required’ => true,
              \n ];
              \n $form[‘query’] = [
              \n ‘#type’ => ‘textarea’,
              \n ‘#attributes’ => [
              \n ‘placeholder’ => ‘Query’,
              \n ],
              \n ‘#description’ => ‘Upto 200 characters allowed’,
              \n ‘#required’ => true,
              \n ];
              \n $form[‘submit’] = [
              \n ‘#type’ => ‘submit’,
              \n ‘#value’ => ‘Send’,<\/p>\n

              ];
              \n return $form;
              \n }<\/p>\n

              \/**
              \n * {@inheritdoc}
              \n *\/
              \n public function validateForm(array &$form, FormStateInterface $form_state) {<\/p>\n

              }<\/p>\n

              \/**
              \n * {@inheritdoc}
              \n *\/
              \n public function submitForm(array &$form, FormStateInterface $form_state) {
              \n \/** @var QueueFactory $queue_factory *\/
              \n $queue_factory = \\Drupal::service(‘queue’);
              \n \/** @var QueueInterface $queue *\/
              \n $queue = $queue_factory->get(’email_processor’);
              \n $item = new \\stdClass();
              \n $item->username = $form_state->getValue(‘name’);
              \n $item->email = $form_state->getValue(’email’);
              \n $item->query = $form_state->getValue(‘query’);
              \n $queue->createItem($item);
              \n }
              \n}<\/p>\n

              [\/php]<\/p>\n

              First create\u00a0QueueFactory<\/code>\u00a0object from the service container statically and use this object to instantiate a queue object of email_proceesor.<\/p>\n

              Here\u00a0we are calling createItem() function to insert items in Queue.<\/p>\n

              So, whenever a user submits query form an item will be inserted in the Queue.<\/p>\n

              To see the items in Queue use this drush command:<\/p>\n

              drush queue-list<\/p>\n

              EmailEventBase.php<\/p>\n

              The Queue Worker<\/strong><\/p>\n

              The Queue Worker is Plugin so we create\u00a0EmailEventBase.php inside Plugin Folder as attached screenshot of folder structure.<\/p>\n

              [php]<\/p>\n

              <?php<\/p>\n

              \/**
              \n * Handles sending of email.
              \n *
              \n * PHP Version 5
              \n *\/<\/p>\n

              namespace Drupal\\my_module\\Plugin\\QueueWorker;<\/p>\n

              use Drupal\\Core\\Plugin\\ContainerFactoryPluginInterface;
              \nuse Drupal\\Core\\Queue\\QueueWorkerBase;
              \nuse Drupal\\Core\\Mail\\MailManager;
              \nuse Symfony\\Component\\DependencyInjection\\ContainerInterface;<\/p>\n

              \/**
              \n *
              \n * @inheritdoc
              \n *\/
              \nclass EmailEventBase extends QueueWorkerBase implements ContainerFactoryPluginInterface {<\/p>\n

              \/**
              \n *
              \n * @var Drupal\\Core\\Mail\\MailManager
              \n *\/
              \n protected $mail;
              \n \/**
              \n * constructor
              \n *\/
              \n public function __construct(MailManager $mail) {
              \n $this->mail = $mail;
              \n }<\/p>\n

              \/**
              \n * {@inheritdoc}
              \n *\/
              \n public static function create(ContainerInterface $container, array $configuration, $plugin_id, $plugin_definition) {
              \n return new static(
              \n $container->get(‘plugin.manager.mail’)
              \n );
              \n }<\/p>\n

              \/**
              \n * Processes a single item of Queue.
              \n *
              \n *\/
              \n public function processItem($data) {
              \n $params[‘subject’] = t(‘query’);
              \n $params[‘message’] = $data->query;
              \n $params[‘from’] = $data->email;
              \n $params[‘username’] = $data->username;
              \n $to = \\Drupal::config(‘system.site’)->get(‘mail’);
              \n $this->mail->mail(‘my_module’,’query_mail’,$to,’en’,$params,NULL,true);
              \n }
              \n}<\/p>\n

              [\/php]<\/p>\n

              In processItem() function we are processing individual\u00a0items of Queue.<\/p>\n

              Now, let\u2019s create a CronEventProcessor\u00a0plugin that will use this logic on Cron runs or when we will run manually using drush command:<\/p>\n

              CronEventProcessor.php<\/p>\n

              [php]<\/p>\n

              <?php
              \n\/**
              \n *
              \n * PHP Version 5
              \n *\/<\/p>\n

              namespace Drupal\\my_module\\Plugin\\QueueWorker;<\/p>\n

              \/**
              \n *
              \n * @QueueWorker(
              \n * id = "email_processor",
              \n * title = "My custom Queue Worker",
              \n * cron = {"time" = 10}
              \n * )
              \n *\/
              \nclass CronEventProcessor extends EmailEventBase {<\/p>\n

              }<\/p>\n

              [\/php]<\/p>\n

              In this file, we have written annotation. So by writing annotation, we are telling Drupal that whenever cron runs process this queue for 10 seconds.<\/p>\n

              Whenever cron runs Queue Worker will load all the plugins that cron as their key in annotations. The id in annotation is user for creating object of queue.<\/p>\n

              in .module file of your module you need to write hook_mail to send mail.<\/p>\n

              [php]<\/p>\n

              <?php<\/p>\n

              \/**
              \n * Implements hook_mail()
              \n * @param type $key
              \n * @param type $message
              \n * @param type $params
              \n *\/
              \nfunction my_module_mail($key, &$message, $params) {
              \n switch ($key) {
              \n case ‘query_mail’:
              \n $body = "Hi ".$params[‘username’]
              \n . " Thanks for posting your Query"
              \n . $params[‘message’]
              \n . "Your username: " . $params[‘username’]<\/p>\n

              . "Your email: " . $params[’email’];<\/p>\n

              $message[‘from’] = $params[‘from’];
              \n $message[‘subject’] = $params[‘subject’];
              \n $message[‘body’][] = Drupal\\Core\\Mail\\MailFormatHelper::htmlToText($body);
              \n break;
              \n }
              \n}<\/p>\n

              [\/php]<\/p>\n

              To run this queue manually we can use drush command like:-<\/p>\n

              drush<\/span> queue-run email_processor\u00a0–time-limit=10<\/p>\n

              Conclusion:-<\/p>\n

              You should use Queue API instead of native hook_cron(). It has many benefits as compared to hook_cron.<\/p>\n

              Manage your resource intensive tasks on your website using Queue API.<\/p>\n","protected":false},"excerpt":{"rendered":"

              Before I start my writing about Queue Worker, it is important to understand about cron job in Drupal 8. In generic terms, cron is a scheduled job which runs periodically at fixed intervals. cron manages typical tasks such as database maintenance, sending bulk emails, fetching data from a\u00a0third-party on regular basis. It manages short running […]<\/p>\n","protected":false},"author":1058,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"iawp_total_views":152},"categories":[3602,1],"tags":[4862,4423],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/45957"}],"collection":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/users\/1058"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/comments?post=45957"}],"version-history":[{"count":0,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/posts\/45957\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/media?parent=45957"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/categories?post=45957"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tothenew.com\/blog\/wp-json\/wp\/v2\/tags?post=45957"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}