{"id":976416,"date":"2023-10-16T02:19:42","date_gmt":"2023-10-16T09:19:42","guid":{"rendered":"https:\/\/find.codeghost.online\/en-us\/research\/?post_type=msr-research-item&#038;p=976416"},"modified":"2023-10-16T02:19:42","modified_gmt":"2023-10-16T09:19:42","slug":"a-case-for-graphics-driven-query-processing","status":"publish","type":"msr-research-item","link":"https:\/\/find.codeghost.online\/en-us\/research\/publication\/a-case-for-graphics-driven-query-processing\/","title":{"rendered":"A Case for Graphics-Driven Query Processing"},"content":{"rendered":"\n\n\n<p class=\"wp-block-paragraph\"><div class=\"abstractSection abstractInFull\"> <div class=\"abstractSection abstractInFull\"><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Over the past decade, the database research community has directed considerable attention towards harnessing the power of GPUs in query processing engines. The proposed techniques have primarily focused on devising customized low-level mechanisms that utilize the raw hardware parallelism provided abundantly by GPU compute kernels.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In this paper, we advocate a radically different approach &#8211; instead of dealing directly with hardware idiosyncrasies, to leverage the well-established <i>graphics pipeline architecture<\/i> baked into the GPU hardware. A variety of advantages accrue from this high-level abstraction: (a) Extracting the power of GPUs is outsourced to highly-optimized graphics drivers, thereby providing hardware-consciousness for free; (b) Query processing becomes agnostic to changes in GPU architectures (e.g. integrated vs discrete) and vendors, requiring only a change of drivers; (c) Contemporary graphics APIs also support a compute element, facilitating query operator designs that seamlessly straddle the compute and graphics worlds.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As a proof of concept of the above vision, we implement here the workhorse Join and GroupBy operators using core graphics primitives. These implementations, based on the Vulkan API, have been evaluated over large benchmark databases on vanilla hybrid computing platforms. The experimental results indicate both substantive performance benefits (typically, around 2X faster) over existing approaches, as well as auto-tuned portability to new hardware platforms.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/div> <\/div><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Over the past decade, the database research community has directed considerable attention towards harnessing the power of GPUs in query processing engines. The proposed techniques have primarily focused on devising customized low-level mechanisms that utilize the raw hardware parallelism provided abundantly by GPU compute kernels. In this paper, we advocate a radically different approach &#8211; [&hellip;]<\/p>\n","protected":false},"featured_media":976443,"template":"","meta":{"msr-url-field":"","msr-podcast-episode":"","msrModifiedDate":"","msrModifiedDateEnabled":false,"ep_exclude_from_search":false,"_classifai_error":"","msr-author-ordering":[{"type":"user_nicename","value":"Harish Doraiswamy","user_id":"41051"},{"type":"text","value":"Vikas Kalagi","user_id":0},{"type":"user_nicename","value":"Karthik Ramachandra","user_id":"37658"},{"type":"text","value":"Jayant R. Haritsa","user_id":0}],"msr_publishername":"","msr_publisher_other":"","msr_booktitle":"","msr_chapter":"","msr_edition":"","msr_editors":"","msr_how_published":"","msr_isbn":"","msr_issue":"10","msr_journal":"Proceedings of the VLDB Endowment","msr_number":"","msr_organization":"","msr_pages_string":"2499\u20132511","msr_page_range_start":"2499","msr_page_range_end":"2511","msr_series":"","msr_volume":"16","msr_copyright":"","msr_conference_name":"","msr_doi":"10.14778\/3603581.3603590","msr_arxiv_id":"","msr_mag_id":"","msr_other_authors":"","msr_other_contributors":"","msr_speaker":"","msr_award":"","msr_affiliation":"","msr_institution":"","msr_host":"","msr_version":"","msr_duration":"","msr_release_tracker_id":"","msr_highlight_type":"","msr_date_display_format":"","msr_main_download_label":"","msr_external_link_label":"","msr_doi_label":"","msr_published_date":"2023-08-08","msr_startdate":"","msr_presentation_date":"","msr_highlight_text":"","msr_notes":"","msr_longbiography":"","msr_publicationurl":"","msr_external_url":"","msr_secondary_video_url":"","msr_conference_url":"","msr_journal_url":"","msr_year":2023,"msr_month":8,"msr_day":8,"msr_microsoftintellectualproperty":true,"msr_pub_id":"","msr_publication_uploader":[{"type":"doi","viewUrl":"false","id":false,"title":"https:\/\/doi.org\/10.14778\/3603581.3603590","label_id":243106,"label":0},{"type":"file","viewUrl":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2023\/10\/garuda-pvldb.pdf","id":976425,"title":"garuda-pvldb","label_id":243109,"label":0}],"msr_related_uploader":[],"msr_original_fields_of_study":[],"msr_s2_paper_id":"","msr_s2_pdf_url":"","msr_citation_count_updated":"","msr_citation_count":0,"msr_influential_citations":0,"msr_reference_count":0,"msr_s2_open_access":false,"msr_s2_author_ids":[],"msr_pub_ids":[],"msr_hide_image_in_river":0,"footnotes":""},"msr-research-highlight":[],"research-area":[13563],"msr-publication-type":[193715],"msr-publisher":[],"msr-publication-cta":[],"msr-focus-area":[],"msr-locale":[268875],"msr-post-option":[],"msr-field-of-study":[248884],"msr-conference":[],"msr-journal":[],"msr-impact-theme":[],"msr-pillar":[],"class_list":["post-976416","msr-research-item","type-msr-research-item","status-publish","has-post-thumbnail","hentry","msr-research-area-data-platform-analytics","msr-locale-en_us","msr-field-of-study-database"],"msr_publishername":"","msr_edition":"","msr_affiliation":"","msr_published_date":"2023-08-08","msr_host":"","msr_duration":"","msr_version":"","msr_speaker":"","msr_other_contributors":"","msr_booktitle":"","msr_pages_string":"2499\u20132511","msr_chapter":"","msr_isbn":"","msr_journal":"Proceedings of the VLDB Endowment","msr_volume":"16","msr_number":"","msr_editors":"","msr_series":"","msr_issue":"10","msr_organization":"","msr_how_published":"","msr_notes":"","msr_highlight_text":"","msr_release_tracker_id":"","msr_original_fields_of_study":"","msr_download_urls":"","msr_external_url":"","msr_secondary_video_url":"","msr_longbiography":"","msr_microsoftintellectualproperty":1,"msr_main_download":"","msr_publicationurl":"","msr_doi":"10.14778\/3603581.3603590","msr_publication_uploader":[{"type":"doi","viewUrl":"false","id":"false","title":"https:\/\/doi.org\/10.14778\/3603581.3603590","label_id":"243106","label":0},{"type":"file","viewUrl":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2023\/10\/garuda-pvldb.pdf","id":"976425","title":"garuda-pvldb","label_id":"243109","label":0}],"msr_related_uploader":[],"msr_citation_count":0,"msr_citation_count_updated":"","msr_s2_paper_id":"","msr_influential_citations":0,"msr_reference_count":0,"msr_arxiv_id":"","msr_s2_author_ids":[],"msr_s2_open_access":false,"msr_s2_pdf_url":null,"msr_attachments":[{"id":976428,"url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2023\/10\/garuda-pvldb-652cfc1185a6c.pdf"},{"id":976425,"url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-content\/uploads\/2023\/10\/garuda-pvldb.pdf"}],"msr-author-ordering":[{"type":"user_nicename","value":"Harish Doraiswamy","user_id":41051,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Harish Doraiswamy"},{"type":"text","value":"Vikas Kalagi","user_id":0,"rest_url":false},{"type":"user_nicename","value":"Karthik Ramachandra","user_id":37658,"rest_url":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/microsoft-research\/v1\/researchers?person=Karthik Ramachandra"},{"type":"text","value":"Jayant R. Haritsa","user_id":0,"rest_url":false}],"msr_impact_theme":[],"msr_research_lab":[],"msr_event":[],"msr_group":[],"msr_project":[967329],"publication":[],"video":[],"msr-tool":[],"msr_publication_type":"article","related_content":{"projects":[{"ID":967329,"post_title":"Domain Specialization","post_name":"domain-specialization","post_type":"msr-project","post_date":"2023-10-16 02:14:29","post_modified":"2026-06-24 12:15:52","post_status":"publish","permalink":"https:\/\/find.codeghost.online\/en-us\/research\/project\/domain-specialization\/","post_excerpt":"Scaling performance beyond Moore's law Note: This research project has reached its conclusion. These pages are maintained for reference and archival purposes. Domain\u00a0specialization\u00a0is\u00a0expected\u00a0to\u00a0play\u00a0a\u00a0big\u00a0role\u00a0in\u00a0how\u00a0computer\u00a0systems\u00a0evolve\u00a0in\u00a0future. With\u00a0the\u00a0end\u00a0of\u00a0Moore's Law, we\u00a0are\u00a0already\u00a0seeing\u00a0CPU,\u00a0GPU\u00a0and domain specific\u00a0hardware\u00a0evolving\u00a0rapidly. The next decade\u00a0is\u00a0therefore expected\u00a0to see\u00a0big\u00a0changes\u00a0in\u00a0how\u00a0we\u00a0develop,\u00a0compile\u00a0and\u00a0run\u00a0software. This project focuses on data systems, a class of systems where, as the data sizes grow, performance scaling is going to be of importance.First,\u00a0we\u00a0believe\u00a0that domain-specific\u00a0compilers\u00a0will\u00a0play\u00a0a\u00a0crucial\u00a0strategic\u00a0role\u00a0in\u00a0helping\u00a0software\u00a0leverage\u00a0the changing hardware landscape. Such compilers will be multi-layered and will progressively lower computation through multiple intermediate abstractions,&hellip;","_links":{"self":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-project\/967329"}]}}]},"_links":{"self":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/976416","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item"}],"about":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/types\/msr-research-item"}],"version-history":[{"count":1,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/976416\/revisions"}],"predecessor-version":[{"id":976437,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-item\/976416\/revisions\/976437"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/media\/976443"}],"wp:attachment":[{"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/media?parent=976416"}],"wp:term":[{"taxonomy":"msr-research-highlight","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-research-highlight?post=976416"},{"taxonomy":"msr-research-area","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/research-area?post=976416"},{"taxonomy":"msr-publication-type","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-publication-type?post=976416"},{"taxonomy":"msr-publisher","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-publisher?post=976416"},{"taxonomy":"msr-publication-cta","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-publication-cta?post=976416"},{"taxonomy":"msr-focus-area","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-focus-area?post=976416"},{"taxonomy":"msr-locale","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-locale?post=976416"},{"taxonomy":"msr-post-option","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-post-option?post=976416"},{"taxonomy":"msr-field-of-study","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-field-of-study?post=976416"},{"taxonomy":"msr-conference","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-conference?post=976416"},{"taxonomy":"msr-journal","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-journal?post=976416"},{"taxonomy":"msr-impact-theme","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-impact-theme?post=976416"},{"taxonomy":"msr-pillar","embeddable":true,"href":"https:\/\/find.codeghost.online\/en-us\/research\/wp-json\/wp\/v2\/msr-pillar?post=976416"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}