{"id":1366,"date":"2016-11-19T17:55:32","date_gmt":"2016-11-19T17:55:32","guid":{"rendered":"http:\/\/memecon.info\/?p=1366"},"modified":"2018-05-18T07:30:26","modified_gmt":"2018-05-18T07:30:26","slug":"batch-processing-memory-of-the-future","status":"publish","type":"post","link":"https:\/\/www.memecon.info\/?p=1366","title":{"rendered":"Batch processing &#8211; memory of the future"},"content":{"rendered":"<p>An important reason for the introduction of writing 6500 years ago was, besides religious and ritual reasons as well as writing chronicles, the administration of lists and tables in the context of bookkeeping. In those days there were certainly moments, in which the scriveners could not perform their tasks in a timely matter and created that way piles of unfinished tasks. In this case the employees had to invent accelerated transactions, in order to process the piles. Even if there were no electronic data processing at that time, with no doubt they already had invented the batch processing.<\/p>\n<p><a href=\"http:\/\/memecon.info\/wp-content\/uploads\/2016\/10\/Papierstapel.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1367\" src=\"http:\/\/memecon.info\/wp-content\/uploads\/2016\/10\/Papierstapel.jpg\" alt=\"papierstapel\" width=\"835\" height=\"641\" srcset=\"https:\/\/www.memecon.info\/wp-content\/uploads\/2016\/10\/Papierstapel.jpg 835w, https:\/\/www.memecon.info\/wp-content\/uploads\/2016\/10\/Papierstapel-300x230.jpg 300w, https:\/\/www.memecon.info\/wp-content\/uploads\/2016\/10\/Papierstapel-768x590.jpg 768w, https:\/\/www.memecon.info\/wp-content\/uploads\/2016\/10\/Papierstapel-624x479.jpg 624w\" sizes=\"auto, (max-width: 835px) 100vw, 835px\" \/><\/a><\/p>\n<p>On the mainframes of today the batch processes are running over night, which transfer the accrued data of the day into the respective systems and databases. If the night is not long enough, the appropriate batch window must be expanded by additional computer capacities. The processing follows thereby different patterns.<\/p>\n<ul>\n<li><strong>First come, first serve<br \/>\n<\/strong>In medieval times strict grinding rules were defined, in order to prevent fiddles. Until today this rule provides fair handling for requests that are submitted one after the other. The sequence results from the entry. The pile grows and the affairs are processed from bottom up.<\/li>\n<li><strong>Nip the things in the bud<br \/>\n<\/strong>The advantage of preferring the last entry comes from the fact that the file already lies on the table and thus does not have to be sorted. As long as you have sufficient resources, you can avoid this way any piles. Since this leads to a waste of capacities, if there are no orders, this approach is only economical, if it saves costs of pile administration or storage space.<\/li>\n<li><strong>Burning issues<br \/>\n<\/strong>Already Eisenhower was concerned with the question, what should be first dealt with. The matrix that was named after him, recommends to immediately take care of the urgent things or at least to delegate them to competent employees. The sequence depends on the expiration date of the task. For this purpose you need a good overview of the due dates in the pile.<\/li>\n<li><strong>The more danger, the more honor<br \/>\n<\/strong>In this case you engage with the most extensive tasks first. They can stem from the value of the result, from the required effort for processing or the number of involved people. Naturally they take especially long. With the earliest possible beginning, the probability rises to finish timely. For this purpose the procedures must be evaluated according to their extent and then be sorted in descending order.<\/li>\n<li><strong>Many pennies make a dollar<br \/>\n<\/strong>In this case you emphasize on the tasks with the fewest extent first. Also here, as within the last bullet point, the importance is derived from the value of the result, from the required effort for processing or the number of involved people. These tasks will probably need less effort. By the preferential processing of these tasks the pile quickly gets significantly smaller. The procedures are also evaluated according to their extent, but then be sorted in ascending order.<\/li>\n<\/ul>\n<p>In data processing the data are not processed with one of the above procedures, but after the logical relationships of the databases and files. The goal is to have a consistent volume of data the next day. The height of the pile depends thereby on the IT for collecting the procedures. Appropriate rules bring the data already into a format that can be processed faster, when they are typed in.<\/p>\n<p>In the agile projects of today you use piles, the so-called Backlogs, likewise. Here you simply collect the tasks that are not yet realized. The Product Owner, i.e. a decisive representative of the field, determines after a sprint, which tasks are developed in the next sprint. A sprint is a two to four-week work cycle, in which the developers have full control of the conversion.<\/p>\n<p>Thus, the night window for the completion of batch runs corresponds to a sprint. The substantial difference is that the batch window must complete all planned procedures, since otherwise the consistency of the data is no longer secured. If a task is not finished in a sprint, you can use the subsequent sprint or put it pack into the backlog.<\/p>\n<p>Bottom line: Batch processing was always needed. The difference results from processing and the sorting of the piles &#8211; FIFO, LIFO, FEFO, HIFO, and LOFO. In the context of the agile organization the Product Owner makes the decision, but they also still follow the same patterns. That makes the batch processing a memory of the future.<\/p>\n<div class=\"shariff shariff-align-left shariff-widget-align-left\"><ul class=\"shariff-buttons theme-round orientation-horizontal buttonsize-medium\"><li class=\"shariff-button xing shariff-nocustomcolor\" style=\"background-color:#29888a\"><a href=\"https:\/\/www.xing.com\/spi\/shares\/new?url=https%3A%2F%2Fwww.memecon.info%2F%3Fp%3D1366\" title=\"Bei XING teilen\" aria-label=\"Bei XING teilen\" role=\"button\" rel=\"noopener nofollow\" class=\"shariff-link\" style=\"; background-color:#126567; color:#fff\" target=\"_blank\"><span class=\"shariff-icon\" style=\"\"><svg width=\"32px\" height=\"20px\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 25 32\"><path fill=\"#126567\" d=\"M10.7 11.9q-0.2 0.3-4.6 8.2-0.5 0.8-1.2 0.8h-4.3q-0.4 0-0.5-0.3t0-0.6l4.5-8q0 0 0 0l-2.9-5q-0.2-0.4 0-0.7 0.2-0.3 0.5-0.3h4.3q0.7 0 1.2 0.8zM25.1 0.4q0.2 0.3 0 0.7l-9.4 16.7 6 11q0.2 0.4 0 0.6-0.2 0.3-0.6 0.3h-4.3q-0.7 0-1.2-0.8l-6-11.1q0.3-0.6 9.5-16.8 0.4-0.8 1.2-0.8h4.3q0.4 0 0.5 0.3z\"\/><\/svg><\/span><\/a><\/li><li class=\"shariff-button linkedin shariff-nocustomcolor\" style=\"background-color:#1488bf\"><a href=\"https:\/\/www.linkedin.com\/sharing\/share-offsite\/?url=https%3A%2F%2Fwww.memecon.info%2F%3Fp%3D1366\" title=\"Bei LinkedIn teilen\" aria-label=\"Bei LinkedIn teilen\" role=\"button\" rel=\"noopener nofollow\" class=\"shariff-link\" style=\"; background-color:#0077b5; color:#fff\" target=\"_blank\"><span class=\"shariff-icon\" style=\"\"><svg width=\"32px\" height=\"20px\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 27 32\"><path fill=\"#0077b5\" d=\"M6.2 11.2v17.7h-5.9v-17.7h5.9zM6.6 5.7q0 1.3-0.9 2.2t-2.4 0.9h0q-1.5 0-2.4-0.9t-0.9-2.2 0.9-2.2 2.4-0.9 2.4 0.9 0.9 2.2zM27.4 18.7v10.1h-5.9v-9.5q0-1.9-0.7-2.9t-2.3-1.1q-1.1 0-1.9 0.6t-1.2 1.5q-0.2 0.5-0.2 1.4v9.9h-5.9q0-7.1 0-11.6t0-5.3l0-0.9h5.9v2.6h0q0.4-0.6 0.7-1t1-0.9 1.6-0.8 2-0.3q3 0 4.9 2t1.9 6z\"\/><\/svg><\/span><\/a><\/li><li class=\"shariff-button facebook shariff-nocustomcolor\" style=\"background-color:#4273c8\"><a href=\"https:\/\/www.facebook.com\/sharer\/sharer.php?u=https%3A%2F%2Fwww.memecon.info%2F%3Fp%3D1366\" title=\"Bei Facebook teilen\" aria-label=\"Bei Facebook teilen\" role=\"button\" rel=\"nofollow\" class=\"shariff-link\" style=\"; background-color:#3b5998; color:#fff\" target=\"_blank\"><span class=\"shariff-icon\" style=\"\"><svg width=\"32px\" height=\"20px\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 18 32\"><path fill=\"#3b5998\" d=\"M17.1 0.2v4.7h-2.8q-1.5 0-2.1 0.6t-0.5 1.9v3.4h5.2l-0.7 5.3h-4.5v13.6h-5.5v-13.6h-4.5v-5.3h4.5v-3.9q0-3.3 1.9-5.2t5-1.8q2.6 0 4.1 0.2z\"\/><\/svg><\/span><\/a><\/li><li class=\"shariff-button flipboard shariff-nocustomcolor\" style=\"background-color:#373737\"><a href=\"https:\/\/share.flipboard.com\/bookmarklet\/popout?v=2&title=Batch%20processing%20%E2%80%93%20memory%20of%20the%20future&url=https%3A%2F%2Fwww.memecon.info%2F%3Fp%3D1366\" title=\"Bei Flipboard teilen\" aria-label=\"Bei Flipboard teilen\" role=\"button\" rel=\"noopener nofollow\" class=\"shariff-link\" style=\"; background-color:#f52828; color:#fff\" target=\"_blank\"><span class=\"shariff-icon\" style=\"\"><svg width=\"24px\" height=\"24px\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 24 24\"><path fill=\"#f52828\" d=\"M0 0h8v24H0V0zm9 9h7v7H9V9zm0-9h15v8H9V0z\"\/><\/svg><\/span><\/a><\/li><li class=\"shariff-button twitter shariff-nocustomcolor\" style=\"background-color:#595959\"><a href=\"https:\/\/twitter.com\/share?url=https%3A%2F%2Fwww.memecon.info%2F%3Fp%3D1366&text=Batch%20processing%20%E2%80%93%20memory%20of%20the%20future\" title=\"Bei X teilen\" aria-label=\"Bei X teilen\" role=\"button\" rel=\"noopener nofollow\" class=\"shariff-link\" style=\"; background-color:#000; color:#fff\" target=\"_blank\"><span class=\"shariff-icon\" style=\"\"><svg width=\"32px\" height=\"20px\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" viewBox=\"0 0 24 24\"><path fill=\"#000\" d=\"M14.258 10.152L23.176 0h-2.113l-7.747 8.813L7.133 0H0l9.352 13.328L0 23.973h2.113l8.176-9.309 6.531 9.309h7.133zm-2.895 3.293l-.949-1.328L2.875 1.56h3.246l6.086 8.523.945 1.328 7.91 11.078h-3.246zm0 0\"\/><\/svg><\/span><\/a><\/li><\/ul><\/div>","protected":false},"excerpt":{"rendered":"<p>An important reason for the introduction of writing 6500 years ago was, besides religious and ritual reasons as well as writing chronicles, the administration of lists and tables in the context of bookkeeping. In those days there were certainly moments, in which the scriveners could not perform their tasks in a timely matter and created that way piles of unfinished tasks. In this case the employees had to invent accelerated transactions, in order to process the piles. Even if there were no electronic data processing at that time, with no doubt they already had invented the batch processing. On the mainframes of today the batch processes are running over night, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_crdt_document":"","footnotes":""},"categories":[4,174],"tags":[1331,1335,1333,1336,1334,1337,1332],"class_list":["post-1366","post","type-post","status-publish","format-standard","hentry","category-english","category-management-english","tag-batch","tag-fefo","tag-fifo","tag-hifo","tag-lifo","tag-lofo","tag-processing"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.memecon.info\/index.php?rest_route=\/wp\/v2\/posts\/1366","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.memecon.info\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.memecon.info\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.memecon.info\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.memecon.info\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1366"}],"version-history":[{"count":0,"href":"https:\/\/www.memecon.info\/index.php?rest_route=\/wp\/v2\/posts\/1366\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.memecon.info\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.memecon.info\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.memecon.info\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1366"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}