Data modeling with Amazon DynamoDB - ADB301 - New York AWS Summit
•
14 likes•3,819 views
This document summarizes a presentation on data modeling with Amazon DynamoDB. The presentation covers key DynamoDB concepts like tables, items, primary keys and attributes. It also discusses different data modeling strategies and patterns for modeling one-to-many relationships, including using sort keys, secondary indexes and attribute maps. The presentation provides an example of modeling data for an e-commerce application and demonstrates how to design queries and implement filtering using primary keys and sort key conditions.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Data modeling with Amazon DynamoDB - ADB301 - New York AWS Summit
Similar to Data modeling with Amazon DynamoDB - ADB301 - New York AWS Summit (20)
More from Amazon Web Services
More from Amazon Web Services (20)
Data modeling with Amazon DynamoDB - ADB301 - New York AWS Summit
- 1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Data modeling with Amazon DynamoDB Alex DeBrie Engineering Manager Serverless, Inc. A D B 3 0 1
- 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Agenda What is DynamoDB? Key concepts Data modeling strategies
- 3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Alex DeBrie Engineering Manager, Serverless, Inc. DynamoDBGuide.com @alexbdebrie alexdebrie.com
- 4. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T What is DynamoDB? NoSQL database Fully managed by AWS HTTPS with AWS Identity and Access Management (IAM) Auth Fast, consistent performance as it scales
- 6. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Hyperscale
- 7. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Hyperephemeral compute
- 8. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 9. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Concepts • Table • Item • Primary key • Attributes
- 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
- 11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Table
- 12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Item
- 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Primarykey
- 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Attributes
- 15. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Primary key • Simple primary key (partition key) • Composite primary key (partition key + sort key)
- 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Simple primarykey
- 17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Composite primarykey
- 18. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. API actions • Item-based actions
- 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Item-based actions – Writing, updating, deleting
- 20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Item-based actions – Writing, updating, deleting Must provide entire primary key
- 21. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. API actions • Item-based actions • Query
- 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Query
- 23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Query Must provide partition key May provide sort key conditions
- 24. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. API actions • Item-based actions • Query • Scan
- 25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Scan
- 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Scan Avoid! Expensive at scale
- 27. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Secondary indexes
- 28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Secondaryindexes
- 29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Secondaryindexes
- 30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Secondaryindexes
- 31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Secondaryindexes
- 32. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 33. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Basics 1. Start with an ERD 2. Define your access patterns 3. Design your primary key & secondary indexes
- 34. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Forget your relational experience • Normalization • JOINs • One entity type per table
- 35. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Setup • Ecommerce store • Users make orders • An order may have many items
- 36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T 1. Create your ERD
- 37. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ecommerce store
- 38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T 2. Define your access patterns
- 39. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Identify access patterns 1. Get user profile 2. Get orders for user 3. Get single order and order items 4. Get orders for user by status 5. Get open orders
- 40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T 3. Design your primary keys & secondary indexes
- 41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
- 42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
- 43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
- 44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Entities PK SK User USER#<username> #PROFILE#<username> User address Order Order item
- 45. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 46. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 47. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Denormalization + document types
- 49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Entities PK SK User USER#<username> #PROFILE#<username> User address N/A N/A Order Order item
- 50. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 51. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 52. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T One-to-many: Sort keys
- 53. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Entities PK SK User USER#<username> #PROFILE#<username> User address N/A N/A Order USER#<username> ORDER#<orderId> Order item
- 54. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Entities PK SK User USER#<username> #PROFILE#<username> User address N/A N/A Order USER#<username> ORDER#<orderId> Order item
- 55. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Query: “PK = USER#alexdebrie AND BEGINS_WITH(SK, ‘ORDER#’)”
- 56. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T One-to-many: Sort keys “PK = USER#alexdebrie AND BEGINS_WITH(SK, ‘ORDER#’)”
- 57. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 58. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 59. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
- 60. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Entities PK SK User USER#<username> #PROFILE#<username> User address N/A N/A Order USER#<username> ORDER#<orderId> Order item ITEM#<itemId> ORDER#<orderId>
- 61. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Entities PK SK User USER#<username> #PROFILE#<username> User address N/A N/A Order USER#<username> ORDER#<orderId> Order item ITEM#<itemId> ORDER#<orderId>
- 62. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
- 63. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Inverted index
- 64. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Inverted index
- 65. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Inverted index
- 66. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. One-to-many relationship patterns 1. Attribute (list or map) 2. Primary key + query 3. Secondary index + query
- 67. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
- 68. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering SELECT * FROM ORDERS WHERE USERNAME = ‘alexdebrie’ AND ORDERDATE > GETDATE() - 14
- 69. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 70. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 71. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 72. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 73. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Query Must provide partition key May provide sort key conditions
- 74. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 75. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 76. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 77. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 78. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 79. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 80. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filter expressions
- 81. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders
- 82. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders
- 83. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders SELECT * FROM ORDERS WHERE USERNAME = ‘alexdebrie’
- 84. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering access patterns “PK = USER#alexdebrieAND BEGINS_WITH(SK, ‘ORDER#’)”
- 85. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering patterns: primary key “PK = USER#alexdebrieAND BEGINS_WITH(SK, ‘ORDER#’)”
- 86. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders
- 87. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders SELECT * FROM ORDERS WHERE USERNAME = ‘alexdebrie’ AND STATUS = ‘SHIPPED’
- 88. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T@alexbdebrie Filtering access pattern
- 89. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T@alexbdebrie Filtering access pattern
- 90. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T@alexbdebrie Filtering access pattern
- 91. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T@alexbdebrie Filtering patterns: composite sort key
- 92. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders SELECT * FROM ORDERS WHERE USERNAME = ‘alexdebrie’ AND STATUS = ‘SHIPPED’
- 93. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering patterns: Composite sort key “PK = USER#alexdebrieAND BEGINS_WITH(OrderStatusDate, ‘SHIPPED#’)”
- 94. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filtering patterns: Composite sort key “PK = USER#alexdebrieAND BEGINS_WITH(OrderStatusDate, ‘SHIPPED#’)”
- 95. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders
- 96. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders
- 97. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Filtering access patterns 1. Get orders for user 2. Get orders by status for user 3. Get open orders SELECT * FROM ORDERS WHERE STATUS = ‘PLACED’
- 98. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filteringaccess patterns: Sparse index
- 99. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filteringaccess patterns: Sparse index
- 100. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Filteringaccess patterns: Sparse index
- 101. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Filtering patterns 1. Primary key 2. Composite sort key 3. Sparse index
- 102. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Thank you! S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Alex DeBrie @alexbdebrie alexdebrie.com