在 ongodb 中实现强事务

Size: px

Start display at page:

Download "在 ongodb 中实现强事务"

南颜
5 years ago
Views:

1 在 ongodb 中实现强事务

5 600+ employees 2,000+ customers 13 offices worldwide 15,000,000+ Downloads

RANK DBMS MODEL SCORE GROWTH (20 MO) 1. Oracle Rela+onal DBMS 1,442-5% 2. MySQL Rela+onal DBMS 1,294 2% 3. Microso? SQL Server Rela+onal DBMS 1,131-10% 4. MongoDB Document Store 277 172% 5.

6 RANK DBMS MODEL SCORE GROWTH (20 MO) 1. Oracle Rela+onal DBMS 1,442-5% 2. MySQL Rela+onal DBMS 1,294 2% 3. Microso? SQL Server Rela+onal DBMS 1,131-10% 4. MongoDB Document Store % 5. PostgreSQL Rela+onal DBMS % 6. DB2 Rela+onal DBMS % 7. Microso? Access Rela+onal DBMS % 8. Cassandra Wide Column % 9. SQLite Rela+onal DBMS % Source: DB-engines database popularity rankings; May 2015

7 丰富的查询语句二级索引 NewSQL

9 {! first_name: Paul,! }! surname: Miller,! city: London,! location: [45.123,47.232],! cars: [! ]! { model: Bentley,! year: 1973,! value: , },! { model: Rolls Royce,! year: 1965,! value: , }!

10 10

MongoDB Core Server Replication and Sharding Aggregation Framework Security: Role-Based Access Control, PKI Certificates, SSL, Field-Level Redaction Advanced Security: LDAP Authentication, Kerberos

12 MongoDB Core Server Replication and Sharding Aggregation Framework Security: Role-Based Access Control, PKI Certificates, SSL, Field-Level Redaction Advanced Security: LDAP Authentication, Kerberos Authentication, x.509 Certificates, Auditing Automated Deploy, Configuration, Maintenance, Zero Downtime Upgrades Backup and Point-In-Time Recovery Monitoring and Alerting Encrypted & In-Memory Storage Engines MongoDB Compass MongoDB Connector for BI On-Demand Training Support SLA 1 hr License Type AGPL Commercial

15 !

17 @Transactional! public void transfer(from, to, amount) {! try{!!!begin()!!debit(from, amount);!!credit(to, amount);!!commit();! }! catch(exception e){!!rollback();! }! }! public boolean transfer(from, to, amount) { double origbalance = readbalance(from);! double origbalance2 = readbalance(to);! boolean creditok = false, debitok=false,! try{!!synchronized(from) {!! synchronized(to) {!! debit(from, amount);! credit(to, amount);!! double newbalance = readbalance(from); if(newbalance!= origbalance amount)!!! throw new Exception( wrong );!! }!!}! }! catch(exception e){!! // if debit has been done! undodebit(from, amount);!! return false;! }! return true!! }!

18 db.employee.update({ _id: 100}, {! $inc:! { salary: },! $set: { level: 10 }! }! )! db.employee.update({ level:9}, {! $inc: { salary: },! }! )! db.employee.update( ) db.salary.update( )!

19 POIN POINT

20 T4 T1 DB Transac+on Manager! T1 Queue

21 ! Eric Brewer Professor, UC Berkeley VP Infrastructure, Google

23 强一致 vs 最终一致 Full ACID 强一致非分布式无大规模并发 Partial ACID 最终一致分布式大规模并发

24 public void transfer(from, to, amount){!!debit(from, amount);!!credit(to, amount);! }!

25 Transaction Compensation

26 hrps://msdn.microso?.com/en- us/library/dn aspx

27 public boolean placeorder(order) {!!!!boolean inventoryupdated,ordersaved, paymentreceived;!!!! }!!inventoryupdated = subtractinventory(order.sku, order.quantity);!!if(inventoryupdated){!!!ordersaved = saveorder(order);!!!if(ordersaved)!!!!paymentreceived = processpayment(order);!!}!!if(!paymentreceived){!!!if(ordersaved)!!!!updateorderstatus(order, "canceled");!!!if(inventoryupdated)!!!!addinventory(order.sku, order.quantity);!!}!!else if(!ordersaved){!!!if(inventoryupdated)!!!!addinventory(order.sku, order.quantity);!!}!

28 !

33 # git clone Account.java LoadTest.java testtransfer() AccountManager.java transfer() debit() debit_compensator() credit() credit_compensator()

34 package com.mongoing.mongosaga;!! public class AccountManager Account public void transfer(from, to, amount) {!!account.debit(from, amount);!!account.credit(to, amount);! }!! }!

35 public class Account {!...! private DBCollection public void debit(string from, double amount){! log.info("debit " + amount+" from account "+from);! accounts.update(new BasicDBObject("name", from),! new BasicDBObject("$inc", new BasicDBObject("balance", -1* amount)));! }! public void debit_compensator(string from, double amount){! log.info( compensating debit operation, adding " + amount+" back to "+from);! accounts.update(new BasicDBObject("name", from),! new BasicDBObject("$inc", new BasicDBObject("balance", amount)));! public void credit(string to, double amount){! log.info("credit "+ amount+" to "+to);! accounts.update(new BasicDBObject("name", to),! new BasicDBObject("$inc", new BasicDBObject("balance", amount)));! }! public void credit_compensator(string to, double amount){! log.info( compensating credit operation, subtract " + amount+" from "+to);! accounts.update(new BasicDBObject("name", to),! new BasicDBObject("$inc", new BasicDBObject("balance", -1* amount)));! }!!

36 ...! final class Worker implements Runnable {! int id;! public Worker(int id){ this.id=id; }! public void run(){! int amount = (int)(math.random()*100)+1;! for(int k=0;k<1000;k++){! try{! counter[0]++;! accountmanager.transfer("mona"+ id, "tj"+ id, amount); }! catch(exception e){ counter[1]++; }! }! }! }! int poolsize = 100;! ExecutorService executor = Executors.newFixedThreadPool(poolSize);! for (int i = 0; i < poolsize; i++) {! executor.execute(new Worker(i));! }!

37 MacBook- Pro- 13:compensatable tjworks$ mvn clean test - Dtest=LoadTest T E S T S Running com.mongoing.mongosaga.loadtest 224 [main] INFO org.springframework.beans.factory.xml.xmlbeandefini+onreader - Loading XML bean defini+ons from class path resource [applica+oncontext.xml] #### Time used: 25s #### Total compensa+ons: 6994 out of total op: Results : Tests run: 2, Failures: 0, Errors: 0, Skipped: 0!

38 > db.accounts.aggregate({$group:{_id:"", sum: {$sum: "$balance"}}}) { "_id" : "", "sum" : 0 } > > db.accounts.find().limit(10) { "_id" : ObjectId("57319bacc026280ce28867a3"), "name" : "tj0", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867a4"), "name" : "mona0", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867a5"), "name" : "tj1", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867a6"), "name" : "mona1", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867a7"), "name" : "tj2", "balance" : 5000 } { "_id" : ObjectId("57319bacc026280ce28867a8"), "name" : "mona2", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867a9"), "name" : "tj3", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867aa"), "name" : "mona3", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867ab"), "name" : "tj4", "balance" : } { "_id" : ObjectId("57319bacc026280ce28867ac"), "name" : "mona4", "balance" : } >

39 SUB POINT

40 SUB POINT Transfers/s Mongo DB MySQL

41 SUB POINT SUB POINT

42 SUB POINT SUB POINT

Microsoft PowerPoint - Daniel_Detail_企业版特性 V1.1 for Community.pptx

Microsoft PowerPoint - Daniel_Detail_企业版特性 V1.1 for Community.pptx { MongoDB : 初识企业版 } 周坚资深解决方案架构师 daniel.zhou@mongodb.com 进化开门见山初识企业版 MongoDB Ops Manager MongoDB Compass MongoDB Connector for BI 紧急补丁客户成功计划 24x7 支持监控报警自动化与配置