WO2007134251A3 - Apparatus and method for read consistency in a log mining system - Google Patents

Apparatus and method for read consistency in a log mining system Download PDF

Info

Publication number
WO2007134251A3
WO2007134251A3 PCT/US2007/068808 US2007068808W WO2007134251A3 WO 2007134251 A3 WO2007134251 A3 WO 2007134251A3 US 2007068808 W US2007068808 W US 2007068808W WO 2007134251 A3 WO2007134251 A3 WO 2007134251A3
Authority
WO
WIPO (PCT)
Prior art keywords
data
requested data
mining system
log mining
read consistency
Prior art date
Application number
PCT/US2007/068808
Other languages
French (fr)
Other versions
WO2007134251A2 (en
Inventor
Alok Pareek
Scott Roger Corbin
Jennifer Wei
Lego Haryanto
Eric Ian Fish
Original Assignee
Goldengate Software Inc
Alok Pareek
Scott Roger Corbin
Jennifer Wei
Lego Haryanto
Eric Ian Fish
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goldengate Software Inc, Alok Pareek, Scott Roger Corbin, Jennifer Wei, Lego Haryanto, Eric Ian Fish filed Critical Goldengate Software Inc
Priority to CA2652115A priority Critical patent/CA2652115C/en
Publication of WO2007134251A2 publication Critical patent/WO2007134251A2/en
Publication of WO2007134251A3 publication Critical patent/WO2007134251A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2358—Change logging, detection, and notification

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A computer readable storage medium includes executable instructions to receive a specification for requested data in a log based replication system where data changes are retrieved from both a transaction log and a database. It is determined that the requested data is compromised. A search for a data image containing the requested data is initiated. The data image is accessed to secure the requested data. The requested data is returned.
PCT/US2007/068808 2006-05-12 2007-05-11 Apparatus and method for read consistency in a log mining system WO2007134251A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CA2652115A CA2652115C (en) 2006-05-12 2007-05-11 Apparatus and method for read consistency in a log mining system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US80001506P 2006-05-12 2006-05-12
US60/800,015 2006-05-12

Publications (2)

Publication Number Publication Date
WO2007134251A2 WO2007134251A2 (en) 2007-11-22
WO2007134251A3 true WO2007134251A3 (en) 2008-09-25

Family

ID=38694741

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/068808 WO2007134251A2 (en) 2006-05-12 2007-05-11 Apparatus and method for read consistency in a log mining system

Country Status (3)

Country Link
US (1) US8296269B2 (en)
CA (1) CA2652115C (en)
WO (1) WO2007134251A2 (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7788225B2 (en) * 2005-03-18 2010-08-31 Oracle International Corporation Apparatus and method for identifying asynchronous data in redundant data stores and for re-synchronizing same
US7730106B2 (en) * 2006-12-28 2010-06-01 Teradata Us, Inc. Compression of encrypted data in database management systems
US7769729B2 (en) * 2007-05-21 2010-08-03 Sap Ag Block compression of tables with repeated values
US8271454B2 (en) * 2007-12-18 2012-09-18 Microsoft Corporation Circular log amnesia detection
US8959054B1 (en) * 2010-03-25 2015-02-17 Emc Corporation Methods and apparatus for optimal journaling for continuous data replication
CN102841897B (en) * 2011-06-23 2016-03-02 阿里巴巴集团控股有限公司 A kind of method, Apparatus and system realizing incremental data and extract
US8949271B2 (en) * 2012-10-23 2015-02-03 Liebherr-Werk Nenzing Gmbh Method for monitoring a number of machines and monitoring system
US9904721B1 (en) * 2013-01-25 2018-02-27 Gravic, Inc. Source-side merging of distributed transactions prior to replication
US10083196B2 (en) * 2015-02-04 2018-09-25 Delphix Corporation Creating secure virtual databases storing masked data
US10621152B2 (en) * 2015-12-02 2020-04-14 Speedment, Inc. Methods and systems for mapping object oriented/functional languages to database languages
US11442823B2 (en) * 2016-06-03 2022-09-13 International Business Machines Corporation Transaction consistency query support for replicated data from recovery log to external data stores
US10216582B2 (en) 2016-08-15 2019-02-26 International Business Machines Corporation Recovery log analytics with a big data management platform
US10628278B2 (en) 2017-01-26 2020-04-21 International Business Machines Corporation Generation of end-user sessions from end-user events identified from computer system logs
US11645261B2 (en) 2018-04-27 2023-05-09 Oracle International Corporation System and method for heterogeneous database replication from a remote server
CN109471845A (en) * 2018-10-25 2019-03-15 深圳壹账通智能科技有限公司 Blog management method, server and computer readable storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5043866A (en) * 1988-04-08 1991-08-27 International Business Machines Corporation Soft checkpointing system using log sequence numbers derived from stored data pages and log records for database recovery
US5278982A (en) * 1991-12-23 1994-01-11 International Business Machines Corporation Log archive filtering method for transaction-consistent forward recovery from catastrophic media failures
US5862318A (en) * 1995-10-26 1999-01-19 Microsoft Corporation System for generating a gapless series of identity values
US6014674A (en) * 1996-11-14 2000-01-11 Sybase, Inc. Method for maintaining log compatibility in database systems
US6567928B1 (en) * 2000-05-23 2003-05-20 International Business Machines Corporation Method and apparatus for efficiently recovering from a failure in a database that includes unlogged objects
US20030212789A1 (en) * 2002-05-09 2003-11-13 International Business Machines Corporation Method, system, and program product for sequential coordination of external database application events with asynchronous internal database events
US6728879B1 (en) * 1999-06-02 2004-04-27 Microsoft Corporation Transactional log with multi-sector log block validation
US6845384B2 (en) * 2003-08-01 2005-01-18 Oracle International Corporation One-phase commit in a shared-nothing database system
US7039773B2 (en) * 2003-04-29 2006-05-02 Oracle International Corporation Method and mechanism for efficient implementation of ordered records

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5193162A (en) * 1989-11-06 1993-03-09 Unisys Corporation Cache memory with data compaction for use in the audit trail of a data processing system having record locking capabilities
US5201044A (en) * 1990-04-16 1993-04-06 International Business Machines Corporation Data processing method for file status recovery includes providing a log file of atomic transactions that may span both volatile and non volatile memory
CA2059615A1 (en) * 1991-01-23 1992-07-24 Edward J. Neubauer Method of selecting and representing data
JPH0827755B2 (en) * 1991-02-15 1996-03-21 インターナショナル・ビジネス・マシーンズ・コーポレイション How to access data units at high speed
US5592660A (en) * 1991-03-04 1997-01-07 Fujitsu Limited Database management system to alternately perform retrieval process and updating process
US5333303A (en) * 1991-03-28 1994-07-26 International Business Machines Corporation Method for providing data availability in a transaction-oriented system during restart after a failure
US5280611A (en) * 1991-11-08 1994-01-18 International Business Machines Corporation Method for managing database recovery from failure of a shared store in a system including a plurality of transaction-based systems of the write-ahead logging type
US5440727A (en) * 1991-12-18 1995-08-08 International Business Machines Corporation Asynchronous replica management in shared nothing architectures
US5455946A (en) * 1993-05-21 1995-10-03 International Business Machines Corporation Method and means for archiving modifiable pages in a log based transaction management system
US5561795A (en) * 1994-05-13 1996-10-01 Unisys Corporation Method and apparatus for audit trail logging and data base recovery
US6122675A (en) * 1995-05-05 2000-09-19 Apple Computer, Inc. Replaceable and extensible log component of a network component system
US5956489A (en) * 1995-06-07 1999-09-21 Microsoft Corporation Transaction replication system and method for supporting replicated transaction-based services
US5845292A (en) * 1996-12-16 1998-12-01 Lucent Technologies Inc. System and method for restoring a distributed checkpointed database
US6067550A (en) * 1997-03-10 2000-05-23 Microsoft Corporation Database computer system with application recovery and dependency handling write cache
US5933838A (en) * 1997-03-10 1999-08-03 Microsoft Corporation Database computer system with application recovery and recovery log sequence numbers to optimize recovery
US6490594B1 (en) * 1997-04-04 2002-12-03 Microsoft Corporation Database computer system with application recovery and dependency handling write cache
US5832493A (en) * 1997-04-24 1998-11-03 Trimble Navigation Limited Flash file management system
US5890154A (en) * 1997-06-06 1999-03-30 International Business Machines Corp. Merging database log files through log transformations
US6353836B1 (en) * 1998-02-13 2002-03-05 Oracle Corporation Method and apparatus for transferring data from the cache of one node to the cache of another node
US6161109A (en) * 1998-04-16 2000-12-12 International Business Machines Corporation Accumulating changes in a database management system by copying the data object to the image copy if the data object identifier of the data object is greater than the image identifier of the image copy
US6101504A (en) * 1998-04-24 2000-08-08 Unisys Corp. Method for reducing semaphore contention during a wait to transfer log buffers to persistent storage when performing asynchronous writes to database logs using multiple insertion points
US6185663B1 (en) * 1998-06-15 2001-02-06 Compaq Computer Corporation Computer method and apparatus for file system block allocation with multiple redo
US6199070B1 (en) * 1998-06-18 2001-03-06 International Business Machines Corporation Using a database for program logs
US6598078B1 (en) * 1999-04-29 2003-07-22 Aspect Communications Corporation Method and apparatus for generating a record from a time-marked information stream
KR100390853B1 (en) * 2000-06-07 2003-07-10 차상균 A Logging Method and System for Highly Parallel Recovery Operation in Main-Memory Transaction Processing Systems
US20030204516A1 (en) * 2002-04-24 2003-10-30 Jorg Klosterhalfen Determination of relevant figures for database recovery processes
JP3974538B2 (en) * 2003-02-20 2007-09-12 株式会社日立製作所 Information processing system
US7412460B2 (en) * 2003-06-19 2008-08-12 International Business Machines Corporation DBMS backup without suspending updates and corresponding recovery using separately stored log and data files
US7523343B2 (en) * 2004-04-30 2009-04-21 Microsoft Corporation Real-time file system repairs
US7933927B2 (en) * 2004-11-17 2011-04-26 Bmc Software, Inc. Method and apparatus for building index of source data
US7814057B2 (en) * 2005-04-05 2010-10-12 Microsoft Corporation Page recovery using volume snapshots and logs
US7620660B2 (en) * 2005-06-30 2009-11-17 Microsoft Corporation Pre-image logging for database recovery
CA2626227C (en) * 2005-10-28 2016-07-05 Goldengate Software, Inc. Apparatus and method for creating a real time database replica

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5043866A (en) * 1988-04-08 1991-08-27 International Business Machines Corporation Soft checkpointing system using log sequence numbers derived from stored data pages and log records for database recovery
US5278982A (en) * 1991-12-23 1994-01-11 International Business Machines Corporation Log archive filtering method for transaction-consistent forward recovery from catastrophic media failures
US5862318A (en) * 1995-10-26 1999-01-19 Microsoft Corporation System for generating a gapless series of identity values
US6014674A (en) * 1996-11-14 2000-01-11 Sybase, Inc. Method for maintaining log compatibility in database systems
US6728879B1 (en) * 1999-06-02 2004-04-27 Microsoft Corporation Transactional log with multi-sector log block validation
US6567928B1 (en) * 2000-05-23 2003-05-20 International Business Machines Corporation Method and apparatus for efficiently recovering from a failure in a database that includes unlogged objects
US20030212789A1 (en) * 2002-05-09 2003-11-13 International Business Machines Corporation Method, system, and program product for sequential coordination of external database application events with asynchronous internal database events
US7039773B2 (en) * 2003-04-29 2006-05-02 Oracle International Corporation Method and mechanism for efficient implementation of ordered records
US6845384B2 (en) * 2003-08-01 2005-01-18 Oracle International Corporation One-phase commit in a shared-nothing database system

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
"Microsoft Computer Dictionary", vol. 5TH ED., 2002, MICROSOFT PRESS, REDMOND, WA, pages: 141 *
MOHAN C.A.: "A Transaction Recovery Method Supporting Fine-Granularity Locking and Partial Rollbacks Using Write-Ahead Logging", ACM TRANSACTIONS ON DATABASE SYSTEMS, vol. 17, no. 1, March 1992 (1992-03-01), pages 118 - 120 *
MSOS J.E.B.: "Log-Based recovery for Nested Transactions", PROC. OF THE 13TH VLDB CONF., BRIGHTON, UK, 1 September 1987 (1987-09-01) - 4 September 1987 (1987-09-04) *

Also Published As

Publication number Publication date
CA2652115A1 (en) 2007-11-22
WO2007134251A2 (en) 2007-11-22
US8296269B2 (en) 2012-10-23
US20080046479A1 (en) 2008-02-21
CA2652115C (en) 2015-11-17

Similar Documents

Publication Publication Date Title
WO2007134251A3 (en) Apparatus and method for read consistency in a log mining system
US8676585B1 (en) Synchronizing the playing and displaying of digital content
WO2006088773A3 (en) System and method for enabling a storage system to support multiple volume formats simultaneously
WO2007095456A3 (en) Continuous data protection of block-level volumes
GB2453486A (en) Geographical information display system and method
WO2007078645A3 (en) Method and apparatus for cloning filesystems across computing systems
WO2006115705A3 (en) Apparatus and method for constructing a semantic layer based on xbrl data
WO2006026680A3 (en) Systems and methods for organizing and mapping data
WO2011035095A3 (en) Systems and methods for providing advanced search result page content
WO2010080591A3 (en) Methods and apparatus for content-aware data partitioning and data de-duplication
WO2008005211A3 (en) System and method for retrieving and using block fingerprints for data deduplication
GB0906700D0 (en) Automatically extracting data from semi-stuctured documents
WO2011071656A3 (en) Consistency without ordering dependency
WO2006110368A3 (en) Apparatus and method for data modeling business logic
Darmana On the multiscale modelling of hydrodynamics, mass transfer and chemical reactions in bubble columns
WO2009103620A8 (en) Method and apparatus for the page-by-page provision of an electronic document as a computer graphic
WO2008005826A3 (en) Streaming method and apparatus
WO2010039243A3 (en) Methods and apparatus for analyzing locate and marking operations with respect to facilities maps
WO2007087086A3 (en) Systems and methods for managing data on a portable storage device
TW200743103A (en) Systems and methods for writing data to an optical disc
GB0609172D0 (en) Server System And Method For Facilitating A Transaction
Saboormaleki et al. Prediction of Geomechanical Modeling and Selection of Hydraulic Fracturing Candidate Layer in a Tight Reservoir in SW Iran: A Case Study
Ong A suburban transit oriented development at Cockburn, Western Australia
Ezati et al. Shale Volume Estimation Using FMI Image Logs
WO2014014906A3 (en) A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07797438

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 2652115

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07797438

Country of ref document: EP

Kind code of ref document: A2