@vivekgalatage: Introduction to Parallel Algorithms https://cs.cmu.edu/~guyb/paralg/paralg/parallel.pdf…
Summary
An introductory resource on parallel algorithms, covering fundamental concepts and techniques, from Carnegie Mellon University.
View Cached Full Text
Cached at: 06/15/26, 02:51 AM
Introduction to Parallel Algorithms https://cs.cmu.edu/guyb/paralg/paralg/parallel.pdf… — Source: https://www.cs.cmu.edu/�g�8뫶��sz�2{���v�ƞ��[��v��guyb/paralg/paralg/parallel.pdf @�S�Lȼ��=�A���E �B=��s�/8m`G�9��0 R� V�1��r� � �E9���O1�Z�Ļ�)֞;�l <�za����X6�N��`��֘��l�L8�#�eX��X�b�ފ �5�3C�\\\`U�E�\*xK���5��it3�����Sb9\\����0�C�“/5G�� b;p�t�)ΰ��ЂU�8��t’Z l8I�8˻D� � �<����Ĵ����]���8��”���K��xA�)MW-M1���b]-���x@Zo���2�٦��UsKgu;��3���w���lF��U�ǎ�fN����^��4��l1"��q��8"j����� �\.˺��~D�&������ivlv=xUݺ��xX���ۯ’�\F�y���U�����}��6 �}������*����� �L�y\E�kz��np����;����n狱��Jr��“�?m���;}j;���-謬�fƁ7�-�rO?���r���C��,�q~rS��Ϗ�L��\!V��\>����X�\|�c,�u����� �7���1s�����^\!j\_o�az� �Wu�������"�'����3�軅�� �\`��\|侒 ����7��V� ��� �=h/O�GS\|<����M���ڛ:\.Gt��\\�q~wO\}D\-���\>Ӵ�e�Kh��̸�R��K��������E6��\[E�\\��1������\_s�ƒ���M7�<�C�g�Y��� X��7ȏLt\|ࠦ�ʝ6M S�Ca��r\]�mmj\]j\}jöuEjEjejUj�=��d�%\{\.�sɞO�\|��=���d�'\{~k�c���a?�d�����U�9�����kc����u�X���R�\\�'\> stream x��MO�0���9:�?~�n �64�f�vԴi�Ҡ�o?�NB�f�\] ���q��^K�a@����X�ܐ\`�m�\|��w�N8 ���M�%�4 K\.�x\\"F�Ht2@I�d��\)���I�?�q�rkg���C���2�L������� Ջ��� �9��v0��<�Y:\.7��~�p�p Bv~��<�N T���Q ,���\#\[���ı\_PCl�t?�/�1M'~ղf�cAi��0N��g�N�D7Ӽ\(t�\\�T���;J�dr�N�~U�=ShdǶ\}PN�KU����B�h��M\(A�\!��\}�njCM;����?�����\\�\[b�b�U�̭�a �l�\|\[��Y��df���Xx��3�\`�jh��I�\}\> ��q�5<^���w�`y�V��,�\����Jl(o�eUBjg���2Ut�(‘v�K;G5i’+F��P/�W=:*.qK��@���eT��|��fwa�6���������089������Ղ~k��:�M�8�’#��M ��7Z�N��Q�8�\{D��U��4���?��N��W��d D"� F�^�S\-\\����a���qW�N��^ލk����\}1� 99������ �^ U��8�� ���=�� _�y���C2�� <���BA�C,�ɽ,VC q�qj�w`%��Ա�A^d2l/ �w����Y�h�X]kT/�%�O���M����t" �E�kA�\}Ɋ�2R���Kᨠ�g���zw���\|Y������yp��p�S\+�9�XT���Q����&Y"'��lX�5�JQ����,Y�\\�\_X�Ɏ��y�Мe7A\#���\(��\[ͭ�kk���EƊ̊����úN\.��ԎMճ����t(y�|��Ȇ��ԑ’)*9����`k�cա�z�;�H�3�G���p��k�\x�� B J5�sRD��\_,"J'\}�5���ӳ5/��f��\-��W�^\]�OW����;�Uu٘v5p���\`���R�s��Y\(�'�X�M�Wsg�\(e�@3�T£f�0�ٚ��� �el:��Ѣ\)�w�빚�Ja\-��\{h��,��C�7 I��N��?ѩ��e�r��\)�m\[�&��3�Q��n2�y:\)?�\-O�q�~����As\+�%�TL@��Gkk�p\)�S�\`��C�e�3G�r]����]�4�` �f=��Ң���6EF2t��R�\]T�\>\-��F���;��\*���v�\+o��"�٢� Ȟ����"k�k;u�u3�� �%:ش�e0�� ��s1���\.�<�d�8���wj\} &��N:�oV���Ј�\`ĵ��\(��ck߈��\]�yV�\#@�����Nj��~:��HY甘�IC�B��\+Տ\]�ó��S�W����u���\.�4�����J�\]�Z�\{����ٖ��¿K\]��\>k:��\|z��q\{R�����\)�I��%��C'ȶ�\*����@��fY'�2�N�\[�y��M\\� S=2v����W"�F�i�h���� F�pL ��C�q��,�tc endstream endobj 222 0 obj << /Length 2706 /Filter /FlateDecode \>\> stream xڅYK��� ��W�r��V4�yt��ĻqU�;��:��%�C��&i������1�\\D���V�9m����D���ӛ��h�γ��qS��l�/�p�囧z�[owq����n�����펾�T�M�m������I�����[D�]��B�?��a���QP���T��v[F”�e��!ڮ��PLw)�h����8�ѱ���8Ӷ�յ��w�x� �vW�9�a_��{�ga��]��0#F*�s��‘;��C�g����\���u�8-�����el h�P��-�Fc�1qi������ -�2̈́�D��2a����E���Y4�ior R��b�3{��2�%:A�d���лQZ� �bQs;ScR9;*qv�Vp�G�`�����j�����(9d���,}!|dO)�W �{��s�&�l����)/Z�t��lFY>��p勠慠�r�������>���d%�GU��Ĩ�%��K�`��ˁ����%���Vc�fI Z��MNG�+&��fwM�r��w��?��a����gM+��`�������Q��a2y�А1�R).���1i����Nv��z��I�p��.���L���a��0 �V@��D,���P���}V>�0ݗa�&?��{��6�`��W��|��Q���5�2 ɧ�� ?C���}�B�IX��?%Y,� ۂ��w�|)&�8�%�����[&C��S����N?�h����sW�KУr��Ux���_MD�fjc�ꍯ�Ъ�Ię��}Kw���]b“�� ��,Y��&��X~��7Ƌ���F�:y`��ث���Ta�Y�sc��o�Sm��!��u�P�� U�=}� ��=�“�O�b ������V�>����W�V��5x���r��!@˰l��Jڥ���{�B�b���En��ص ��iw 뭁d\���}�D�v1C q��>G鈟�sN��O�`j|+q� E����H|�YΫű������a~���i�S��b�X�3�f��p}��8�z^5�ᴈ��+��[���t�}4�|9�J%���V�������p���%*V�0�oOo� �>�� endstream endobj 231 0 obj << /Length 3039 /Filter /FlateDecode >> stream xڭZK���ϯБS���Sޔ���&��� �PC�2A�v\\���\(R�>��@��h���h��am����/�_}P�&��2M��y�)�Po�2 3�n�w���T��6ɲ�TՏ*��5O@ɳ�?���5�� Qa�g���h*���p��|4�8?-2G����BtHl� r�k;�!������ /���L������H����V�{�Z���K�ʠ��yx{_�dv�@��+L��C�*p��’豯����!����x�i�Bo^7��?`W*!N��‘8lV���d��W��!Ac�����R��EY/�eL�Q��aُ��o\-�I߁δ���zyEx�bUcגC�x"�\!��P�N\]��1:����ixF/Pv��b�fYVƭҡ�� J��4\)8 J o�@ �O��/�Jd������M\\�3y�9�= ���f��Z�\\��CI�\]�X�����V%����i�wƆu��AP4�n�\)/����\!\]��d�Xr�fsd:j�4�7\-G���ksI�3ɒ�B�j��:�xō�Y6Sͷ�Y?\`\}�� �Γ��t�d��\#i�\]��7f����\[C~q��i\|�j�\(��\!�P�W'aAǤ� �\!\|�P�U��J��%3ř�gK3��HA���Э��s�&��O�Z��I�����2���\#�0�a�\_��s"�\-\|A�xk�@�ꘊ�:I"�Y�u�5/Acմ����\* ����v� ��I�\-���H�B�?�\>��D�uo=���\(�9��;�y���ը;�c\_��A���\#�c�\[5���� �nlX2┇�\|�h~3dQR�0�biލ��N�?�/\>/Q��\#b�<��ΕȻ���"\>������ �d&�FA�� ��PR\-������Oi�xHI1N����Bç0�#�DŽ�?� �}�]�9b���H��0”�7�+k�T}B��f��f��2�i�oEpq�w8O���xe��b�@lͅ����o“����� B����`����6zY����r4XR�f\+���z���hp<Č�Ê�mD�i��J�y%�d ��͞G'Mץ��\[3 rB�V�h9b�@I�5UR\)f1t�1�e�%��sQe��a�s���X\+��\(kIq'r\)\(������\(�\|\.\*�X��X7���O���uMɖ�i8�w&�����G���w�\{��K��2��\`h�J8T9�kJ"ڏ��%1W��k���L\+"vb"�ā����\)fQZI9�l���n�K�y��v���Z��/�2�����RA ��P\] �����<\) �\{ ���,�w�/p�@�20��%����y�4�6��R~���������3��2�&���2��\|�Ϭ��H\[r�y�R��1�;�Y,�c,SP“-.Cc�VݩJ�qԔ� m5S!A{��y�m�3Uי��}�\�ǹc�L�K;&�N`���j�/9ȿ_�ܦt`m#y�N����:�[t�� 1�=��� ��1��E��“��m���=&�f�y�7�� ZT���onh@��O��d;�����I� �^�\(�5��\{&\]f�g��/б��0��NRIJ�0~�;f��k�p=��e\[�\*�����=���U�a����0�He��/\-G7\!p�CP���+�V**�C�“̳�9�����?c= ���e��t�<ԉ�ԧ��6;�c�ֺ� �f9&��滇��x��i��K2*�p=D��Ǧ�t���okG��PA�ys�D��/X�3�^�Z9���S��*.�����Eз�G�{����J��q��WJ�(,�|��*��-���V�#��+�/�����͒��q�o��V*Xp��k�s{���7k�K�i������[��BT�����rӿ>���`�����]cQL�I,�Ŋ�T�e4��{/���;ƻ���=\���e�W�I 5���Ƕ� Fa�lH����JX��P7��wV��p�v�<��[��*�P��.�“W��V��g�ۏ��L�?�放��he�A�����d� ���A����lȎAW7��e8 �P��v. �!�5�|Q��^�b�[��� endstream endobj 240 0 obj << /Length 3404 /Filter /FlateDecode >> stream xڽɎ���_Q�%j`J)Q�������40���Kh-=Z������U��#��G�Ƿ����!:|��ow7��A��0F��*��]�”���N�����n�If���A���Tw<�Te�؆\{U�\>�L�����h��ouX�\.i�������V5�~���C��ު\`��dO8��0MOgY�P��\-�v����uSdO�dcO�,��q�=���O\{�'��X/j�����8Z9�o6������B8���������\(�\{;�� y'�lNv�ئ�4 �8��宙�G��y�h�3C�k�E�҅�\!����\[� �蹰�������٘����O�� ������8����ؖ�\]�D��q�Z�hA\[�p\}�C�V\*uar�\_A\+�2ߣ��"��hp���\[���x�\{E�n�n��4,��\\�q\>����=�r�X��\+�y�\_ �TJnY���uc���~���\*��,M���a\*m��E���\}�\+���m�9�� �Hm��“#R��r�4�(Y5w�,�r�1Y5E�”��SSY7#�[lzb�(�ID-����#Y�ѡ’���/] вc?c��`�ד� � ��l�p�ۺ�p�0�!‘�m#�������%j��D��Q��WE��“Ȝ�P�rb��6�s�{��J�P�Mtw�H,�j�M�� ��Ğ^R}�ga8G|K“X����Cd0udi��b�R8�� LJlC�(�L����8;��N�\D2\��S�e�Մ� �”;�d���̽��֢���@C,> �ЗF�}+7�tR+�gi��FPN���!���,���K��Ӡ��8�����<����9�7ɏX�;B1�Ԇ[�m,��q)�R��g54��@���Om�S��ܩ�����������끰��lI�V\\� /BJ�@%���b�̝s��Ϸ�i����TF�\_��AD�\.�8�cl�H�ε �(,M�UY�DGDZ�(���*N�prxɳ%���NaPD � /�3a:���2ru���� 7\͜:ޮ���+�;T}�L�~~����8�j�����s��h��/��7쳞� sX jN<�ԫ�\��&�ә��S�4[�-8(�p���%������?�B}1�����o�И�m ��#��gϤv�?��w*“ J=ġ���щu����WLR�PbCX�z�ӿ�k�,����J��4��^QD�l�� H��h;�K^�۪ W1�j�����ֺ�G��?�’� ̈́�:!�M�|����J b�:S�eNDw�,�I����Kμ���{O� o\!���bc�[�X���l4���+ھ�S�0�`B��`�n �4��!�elC!�J����W.9�?F�;^o��+��Y���9���&�}���͂��S0�ֲ�&ƚ8�4s�a G��h��H���ιL����s(���s`O>�(H�p�#���L�Sz #���M���Ӹ�\`�����\]ɦl�Y4I�\#�E��Ի"� M��9�~���\`���\(��\(PsXlꊑv~8v\.yu��P�s��2�� \*W�\]��uW1W�����J���&��jœ�\*�\(WI�\+�"�<̤SKoir�\!��Z��So4����sۖ� �0�0\.��G�'j�����i�\(KA �?�ʼn��AN1�߯ �%®Y�N�E��g,��� ;‘���’(�� hs��: ��u&`Z�A5���<�{ט|Ǭ\���xUj�`�0k��N�ܥ�T6������y#�`?z}����Uc�ke�5r��%륤�θZ뢄�p�nm p�uҀ���C��a�/��7�Rh s�^ ��� )“���E4!�8{����7M��,�e����-a�:b|�� X�P }����zdw��)��ɝ��ˏ��������4O��ڧ5O8E��j�U���TE\_:6:C�տ��ר�D2��;���7J^��c�w���d�c?�\\XS�Ns�\+�\)~��������n/o� �\{�E�T��� �d���r;��r� �Kvs����R��J��K�ο�ᦞO7T�9��h�F�\*\+U\{���p��<�\!�~&��ȓIs��Ϳ��H�� �0� ��1�p1DƙW���m��g/��\`�o�\#���ذ'i;�L��^�z�\*��ru\*R�n��Ryĕ\-u;j�R�\+�M��v8�k�?Q�&Y�\* q���\)UH� t��H��\> stream xڕZIo�F��W�� ����V��4�8����99�d��c6��bY�|�Vl��&��X�j����:<���wJ�x���XtFqj�M����Q����:�|�x�t�����?xo�A�0O��’cB�f<���xV�/g�<�a2�65c}��t���?n��(��O�+ڪ�������Ey�[��8�M%��QOǓ>�C����uMjCk��k�zq����:(�;���L7�S�O& J��p{x<�I��p��q�ێ���6.E�Y����#��vꦶrӯ���/G���xJR�T�8����Ñ���<6^䌺�*Ǻ�Ctw<�? ���HWWrg�3���_`�������Ǿ�rg�o��j��oo�; �Ip)�Gitx�s��V�3et��.x�g,x��R{��%������&��#���N�A��x(7��0���^��D^2�G �G���/�A7�ci��ur���+��1��<2�-�Ii���Sw/M�V�솝Ϥo;{&&����زuϼ%�L�Tl�@ s`ފ�k;F1j��f�� ` �qꮍ���t�%�dй=*�Б8�ѱ�BdVqp�4L�� /�KǢ�U��/��Զtm��p�`0����”&%�d�^ sc�< l��;HP�� 5�0�,�Ϣ�Q�_떥b���+’O8��� ܔ.���x�Px��Lg>�勳02f-=���w������_6/h,����L2�&rk�r�ʟ�� 2V��CvB�]l��OW������V����U���ށ: ��\# ��O��e�h�T4K������\!��t�q�\[�F���G\`k,4PHm=\\ؽ�G��\\���F �Te\#\}T퐵��B2�Qp啕Cy� �I�k�ay�t~s\`��5�=�����LA :�k����\\�I4K�;�ܩ�\\7f�%^����C�b�&��QBcˮ\>t3qd��a�l��\\ R D~9�� hd\+\}\#1h��=X�\*w�< �\|�\)������Xip��y��r4F\{��:���\[�\>�1\\m��D��ː da�r�ix\_��\!����x�w\}E� ft��6�\\�g�/\-3\|u��뚚�5����\|��:�B�8d��\(~��T�q��Zw����\`��G� ��\[�wbg�P��?���c�0�W�<"�k��~p�W���f�\*c��B�92�I�����kÆ�p�b�u�旱0pY��N����8n�� \[3C�hREN\{�� a���gxSݓ��UD�\{�H�r �� Z�a~Ky��H�< P�29L��5�P�Ǣ��\|���Z�\-�Y<�g<�D�;9��q�������g=�1�o�U���G�1K\}��M\)EM��������d��sЍ�یR�{Y: Sѐ)-�b�mds�^z8�;N�5��T�����Z;*FPa�������{���!S�c١�S�d�U#�q���������BL��v�2�]�6��S�r���Ck�J M*A�r��V_E���k� ���x)v�/%9�YQ߲�gd��6�@`a&�t� ��9 ���k���‘1�3K��h^��B�y�zN��7,̊��%�.B F�/{/�#��6�2L�’��c>9�dv:��Vգ���v��o�RITi`��%&��Z��05X�_;���Z�Rn��r�j��%����]ecڛюN���ԭ+����’l8��+ϼ��Ro�%��TG?��e�ź�H���ס QҖ�� +w���sM>O�1N}�m��L����[ OD����)yQ���WB}�G���f{¶�� ,[�w“@��w�D��c3�|w� �ծ.�v#�M�Wv!����(@�#W�2�“�g�Zn�YFql���+�!���Q�G^1�u�Ղ
Similar Articles
@vivekgalatage: Roadmap from Cornell - Introduction to CUDA http://cvw.cac.cornell.edu/cuda-intro
This article introduces the Cornell Virtual Workshop's free online tutorial on basic CUDA programming using C, covering prerequisites and additional resources.
@vivekgalatage: Memory organization with Algorithmica is one resource that keeps shining. https://en.algorithmica.org/hpc/cpu-cache/
A recommendation for the Algorithmica resource on CPU cache memory organization, which provides detailed experimental analysis and optimization techniques for in-memory algorithms.
In Parallel
In Parallel is an operating system for execution, designed to manage and coordinate parallel workflows and tasks.
@vivekgalatage: One of the finest https://courses.csail.mit.edu/6.851/spring21/
MIT's Advanced Data Structures course (6.851) by Prof. Erik Demaine is available fully online with video lectures and collaborative problem solving.
@vivekgalatage: Best structured reference I've found for GPU optimization - 450 papers, 14 years of research. Some techniques will have…
A tweet shares a structured reference of 450 papers on GPU optimization spanning 14 years, noting that while some techniques evolve, the mental models remain useful. It also references a lecture on GPU architectures by Onur Mutlu.