CN101866315A - Test method and system of software development tool - Google Patents
Test method and system of software development tool Download PDFInfo
- Publication number
- CN101866315A CN101866315A CN 201010204249 CN201010204249A CN101866315A CN 101866315 A CN101866315 A CN 101866315A CN 201010204249 CN201010204249 CN 201010204249 CN 201010204249 A CN201010204249 A CN 201010204249A CN 101866315 A CN101866315 A CN 101866315A
- Authority
- CN
- China
- Prior art keywords
- test
- command
- module
- open source
- stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention relates to a test method and a system of a software development tool. The method comprises the following steps that: 1. a configuring module obtains and stores a construction command of an open source software item, and stores the configured modification mode on the construction command; 2. a test execution module reads the stored construction command, and modifies the construction command stream according to the configuration modification mode for converting the construction command stream into a test command stream; 3. the test execution module invokes the software development tool to be tested for executing the test command stream for carrying out construction process replay; and 4. the test execution module monitors the construction process replay, and a test report generation module generates a test report according to the monitoring results output by the test execution module. The invention can improve the test efficiency on the software development tool.
Description
Technical field
The present invention relates to field of software development, relate in particular to the method for testing and the system of SDK (Software Development Kit).
Background technology
SDK (Software Development Kit), for example instruments such as advanced compilers, Program Static Analysis and error detection as the input data, by source program is handled, are finished functions such as compiling, process analysis with source program.In the performance history of this class SDK (Software Development Kit), Black-box Testing is widely used.Adopt Black-box Testing need in the test process of SDK (Software Development Kit), use a large amount of test cases.Since this class SDK (Software Development Kit) with source program as input, so existing a large amount of open source software project becomes the natural alternative of test set.Yet the open source software project can't directly apply to test.
Usually the program scale of open source software project does not wait from several ten thousand to millions of line codes, complicated source file institutional framework and dependence are arranged, so the software developer is for effective management project and carry out the project compiling fast, use project build language compilation project build mechanism description document, description entry purpose institutional framework and dependence, control item purpose compiling progress, for example the C under Linux the C++ project can use the Makefile file to describe build mechanism, use the make instrument to carry out structure.
In the prior art, serve as that there are the following problems for the structure test set with the open source software project directly: (1) can directly write test script at certain project and finish test, but because the source file of disparity items has different institutional frameworks and dependence, the test script that is common to a plurality of projects is difficult for realizing; (2) the build mechanism description document of open source software project generally is to create along with the exploitation of project, revise and organize, so its content and distribution mode and procedural item be closely related, and does not have general amending method to make it satisfy the needs of test; (3) for extensive open source software project, project build mechanism description document enormous amount revises requiring a great deal of time and manpower one by one; (4) this mechanism is served the project compiling, and therefore the progress monitoring of the analysis of source program and error detection progress monitoring and compiling and inequality can't be directly used in this mechanism the test to process analysis and testing tool.
Summary of the invention
For addressing the above problem, the invention provides the method for testing and the system of SDK (Software Development Kit), utilize the build mechanism of open source software project, improve efficient to the test of SDK (Software Development Kit).
The invention discloses a kind of method of testing of SDK (Software Development Kit), comprising:
Step 1, configuration module obtains and stores the structure order of open source software project, preserves the alter mode to described structure order of configuration;
Step 2, testing execution module read the structure order of storage, revise described structure command stream according to the alter mode of configuration, are converted into test command stream will make up command stream;
Step 3, testing execution module are called SDK (Software Development Kit) to be tested and are carried out described test command stream, carry out building process and reset;
Step 4, testing execution module monitoring building process is reset, and test report generation module generates test report according to the monitored results of testing execution module output.
Described step 1 further is,
Step 21, for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project;
Step 22 to each open source software project, indicates the alter mode of command name, parameter and/or effective object to each type command.
Described testing execution module comprises playback driver module and command process standalone module;
Described step 2 further is,
Step 31, playback driver module read the test profile of storage and make up the command line parameter of command stream, and so that running environment to be set, described test profile comprises the registration table of open source software project;
Step 32, playback driver module read the alter mode that makes up command stream and configuration, and carry out normalized to making up order;
Step 33, the playback driver module is according to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, the command process standalone module of described open source software project correspondence is imported in every order that will make up command stream successively into, and the running environment parameter is provided;
Step 34, described command process standalone module carries out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
Described testing execution module also comprises the command process sharing module,
Described step 3 is further called SDK (Software Development Kit) to be tested for the command process sharing module and is carried out described test command stream, carries out building process and resets.
Described step 4 further is,
Step 51, testing execution module is monitored in real time to the implementation status of test command, the output test log
Step 52, the text of the defect report of SDK (Software Development Kit) is set up in the daily record of test report generation module analytical test;
Step 53, test report generation module travels through each failure part that makes up playback procedure, failure part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then the information with described failure part records in the described text, and the test command that the execution of correspondence is failed is attached to after the failure partial information simultaneously, obtains the defect report of SDK (Software Development Kit).
Described step 3 also comprises, building process is reset, and the test command of carrying out failure is charged to the breakpoint log file;
After executing at least once test, carry out following incremental testing process,
Step 61, the playback driver module is by reading the breakpoint log file, from the breakpoint log file, obtain the structure order of the open source software project of execution single-step operation successively, form and make up command stream, call the breakpoint execution module, the breakpoint execution module is converted into test command stream according to described alter mode with described structure command stream;
Step 62, breakpoint execution module call instruction processing sharing module are carried out described test command and are carried out the building process playback, and the monitoring building process is reset;
Step 63, test report generation module generates test report according to the monitored results of testing execution module output.
The invention also discloses a kind of test macro of SDK (Software Development Kit), comprising:
Configuration module is used to obtain and store the structure order of open source software project, preserves the alter mode to described structure order of configuration;
Testing execution module is used to read the structure order of storage, revises described structure command stream according to the alter mode of configuration, is converted into test command and flows will make up command stream; Call SDK (Software Development Kit) to be tested and carry out described test command stream, carry out building process and reset; The monitoring building process is reset;
Test report generation module is used for generating test report according to the monitored results of testing execution module output.
Described configuration module is further used for for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project; To each open source software project, indicate the alter mode of command name, parameter and/or effective object to each type command.
Described testing execution module comprises playback driver module and command process standalone module;
The playback driver module, the command line parameter that is used to read the test profile of storage and makes up command stream, so that running environment to be set, described test profile comprises the registration table of open source software project; Read the alter mode that makes up command stream and configuration, and carry out normalized making up order; According to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, the command process standalone module of described open source software project correspondence is imported in every order that will make up command stream successively into, and the running environment parameter is provided;
The command process standalone module is used for carrying out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
Described testing execution module also comprises the command process sharing module,
The command process sharing module is used to call SDK (Software Development Kit) to be tested and carries out described test command stream, carries out building process and resets.
The command process sharing module also is used for the implementation status of test command is monitored in real time, returns test log to the playback driver module;
The playback driver module also is used to export described test log;
Test report generation module is used for the text that the defect report of SDK (Software Development Kit) is set up in the analytical test daily record; Travel through the failure part that each makes up playback procedure, failure part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then the information with described failure part records in the described text, the test command that the execution of correspondence is failed is attached to after the failure partial information simultaneously, obtains the defect report of SDK (Software Development Kit).
The command process sharing module also is used for building process is reset, and the test command of carrying out failure is charged to the breakpoint log file;
The playback driver module also is used for obtaining the structure order of the open source software project of execution single-step operation successively by reading the breakpoint log file from the breakpoint log file, forms and makes up command stream, calls the breakpoint execution module;
The breakpoint execution module is used for according to described alter mode described structure command stream being converted into test command and flows, and call instruction processing sharing module is finished the described test command of execution and carried out building process playback and the playback of monitoring building process.
Beneficial effect of the present invention is, utilize the project build mechanism of open source software project dynamically to form test procedure and testing procedure, robotization and finish test to SDK (Software Development Kit) efficiently in its building process of simulation improves the efficient of SDK (Software Development Kit) test; The conversion project build command stream that the present invention proposes is that the method for test command stream makes that the user only needs to write a small amount of code according to the mode of standard, just the open source software project of a complexity can be used for test, avoided that source code is made a large amount of modifications or adjustment and be distributed in a plurality of project build mechanism description document in the project, reduced the required cost of extend testing collection; Provide the standard interface and the reference of project build command process to realize, make the user not need to understand in depth the open source software project that will use, also needn't grasp various project build mechanism descriptive languages, just can formulate test plan neatly, control test process easily; By the incremental testing mode, to make up the order of execution failure in the playback procedure as the test breakpoint, the breakpoint record that keeps each test iteration, it is used for subsequently test iteration as special structure command stream, the result of checking defective, the breakpoint record of each iteration must be the subclass of its test command stream, can shorten effectively and test the required time.
Description of drawings
Fig. 1 is the process flow diagram of the method for testing of SDK (Software Development Kit) of the present invention;
Fig. 2 is the embodiment synoptic diagram that building process is reset;
Fig. 3 is the embodiment synoptic diagram of incremental testing;
Fig. 4 is the structural drawing of the test macro of SDK (Software Development Kit) of the present invention;
Fig. 5 is the structural drawing of testing execution module in the embodiment;
Fig. 6 is the synoptic diagram of the embodiment of system of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
The structure command stream of open source software project is meant the sequential list that makes up order.Wherein make up order and refer in the process of utilizing project build instrument execution build mechanism description document, compiling and the whole open source software project of deployment, the order that the build tool is performed comprises command name, parameter and effective object three parts.
The invention provides an interface specification and reference realization thereof, by the user at each open source software project, indicate processing mode, comprise the modification of command name, parameter and effective object etc., such order can be carried out according to user's testing requirement special type of commands.The present invention is input to make up command stream, and each the bar order in the convection current is judged its type and screened and revise according to the mode of customization, is converted to test command stream and is carried out.The implementation of test command stream can be regarded the simulation to the project build process as, but serves test purpose, therefore is called the playback of building process.Playback along with building process, the open source software project dynamically is converted into the test procedure that can be used for testing, be applied to test simultaneously, when finishing when resetting, test process is also finished thereupon, obtain test result, generate test report, and can utilize test result to do further statistical study as required.
The flow process of the method for testing of SDK (Software Development Kit) of the present invention as shown in Figure 1.
Step S100, configuration module obtains and stores the structure order of open source software project, and preserves the alter mode to described structure order of configuration.
Step S100 is as described below in one embodiment.
Step S110, the structure order of configuration module acquisition and storage open source software project is further for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project.
Current directory, compiling source file, hyperlink target file etc. are for example changed in the order that the build tool is called each step in building process, output to the standard output stream of operating system.The stream redirection mechanism that utilizes operating system to provide is saved in these orders in the file in regular turn, and the present invention is called buildlog file (structure journal file) with this document, and then obtains the structure command stream of open source software project.
With respect to by the described abstract project build mechanism of file that is distributed in the open source software project different levels, the project build command stream is its concrete enforcement record.
One preferred embodiment in, when structure project in advance obtains the structure command stream of project, generate temporary file, and store this temporary file in ad-hoc location.Large-scale open source software project can dynamically generate a large amount of temporary files, for example header file, script or implementing procedure in building process.Generally be indifferent to these temporary files in the test of prior art, but temporary file is the part of whole project build process, the disappearance of certain file can cause some command execution failure, influences the playback of whole building process, makes test result invalid.Because the command process mode of customization generally can be ignored the generation temporary file, so need essential temporary file be generated and place the position that needs by this step.Carry out in the process of test command stream at step S300, temporary file can become the effective object of some test command with source file.
Step S120 to each open source software project, indicates the alter mode of command name, parameter and/or effective object to each type command.
Every the structure order that makes up in the command stream is made up of command name, parameter and effective object three parts, is expressed as C, P, O respectively.One of described configuration is exemplified below described.
Different according to C and P will make up order and be divided into four classifications:
Catalogue change order---change the current place catalogue of building process;
Compiler directive---source files of program is compiled as file destination;
Chained command---file destination is linked as executable file or library file;
Other order---the order except that above-mentioned three classes, for example the establishment order of temporary file.
Because making up the performance history of command stream and open source software project is closely related, can't be directly used in test, disposed the interface specification that comprises one group of function interface among the embodiment, be used for the structure command stream is converted to test command stream, the effective object of test command stream is a subclass of open source software project, test command stream is a series of testing procedures on this test procedure, is used to form test procedure.
Configuration is carried out following modification to catalogue change order and is handled.
Catalogue change order only is made up of C and P, and wherein, C represents that catalogue enters or withdraw from operation, the indicate catalogue that enters or withdraw from of P.During concrete enforcement, to catalogue change order alter mode comprise and safeguard a catalogue storehouse, at first C is replaced with the catalogue change command name C ' of operating system; If C for entering operation, then with the current directory pop down, obtains test command＜C ', P 〉; If C is for withdrawing from operation, the P current directory of indicating to withdraw from then, the stack head catalogue that should eject the catalogue storehouse replaces P as parameter P ', the test command that obtains is expressed as＜C ', P ' 〉.
Configuration is carried out following modification to compiler directive and is handled.
The corresponding respectively compilation operations of the C of compiler directive, P, O, pass to the parameter of compiler and source file.Alter mode to compiler directive comprises: the respective operations title C ' that at first C is replaced with the tested software developing instrument; Safeguard two parameter set Pn and Pm simultaneously by user's appointment, comprise the required argument that the tested software developing instrument does not allow the parameter of using and is used to set the SDK (Software Development Kit) state respectively, to the parameters among the P, if belong to Pn then from P, delete, then each parameter among the Pm is inserted P, obtain adjusted P ', revise the test command that obtains and be expressed as＜C ', P ', O 〉.
If the tested software developing instrument is Program Static Analysis and error detection SDK (Software Development Kit), then alter mode also comprises the corresponding relation of noting between source file and the file destination, and makes test command that source file is converted to the acceptable file layout of tested software developing instrument.
Configuration is carried out following modification to chained command and is handled.
The corresponding respectively linked operation of the C of chained command, P, O, pass to the parameter of compiler and one group of file destination.Alter mode to chained command comprises: the respective operations title C ' that at first C is replaced with the tested software developing instrument; Safeguard two parameter set Pn and Pm simultaneously by user's appointment, comprise the required argument that the tested software developing instrument does not allow the parameter of using and is used to set the SDK (Software Development Kit) state respectively, to the parameters among the P, if belong to Pn then from P, delete, then each parameter among the Pm is inserted P, obtain adjusted P '.O is filtered and adjusts, comprise and revise nonconforming filename suffix; Ignore the effective object that does not generate; Perhaps replace with another group effective object, for example, then should file destination be replaced with pretreated source file according to the corresponding relation record between source file and the file destination if the tested software developing instrument is Program Static Analysis and error detection SDK (Software Development Kit).Obtain test command after the modification and be expressed as＜C ', P ', O ' 〉.
Following modification is carried out in other order to be handled.
Alter mode to other order comprises user-specified command set of types T of maintenance, wherein comprise and need other command type of carrying out in the playback procedure, during modification command type is judged, if command type belongs to the command type that comprises among the T, then carry out corresponding modification, otherwise this order is left in the basket.For example there is archive order ar in the building process of certain class open source software project, be used for one group of file of input is merged into a file, the effective object of this order be before the file destinations of many compiler directives output, and merge files that the back generates as after the effective object of chained command.If the file layout of exporting when the tested software developing instrument is carried out by compiler directive is different with file destination, then the user need specify ar process of commands mode, concrete operations comprise ignoring carries out the ar order, preserve the mapping relations between import file name and the export file name simultaneously, if occurred the export file name of this ar order afterwards in the chained command, then can replace with the title of corresponding former input file by the mapping relations of inquiry preservation.
Step S200, testing execution module reads the structure order of storage, revises described structure command stream according to the alter mode of configuration, is converted into test command stream will make up command stream.
Testing execution module comprises command process standalone module, playback driver module, command process sharing module.
Step S210, playback driver module read the test profile of storage and make up the command line parameter of command stream, so that running environment to be set; Described test profile comprises the registration table of open source software project.
The registration table of open source software project, be used for depositing all open source software projects of test set＜title, the position〉right, the playback driver module is known open source software project and the position thereof that will use by scanning this registration table.
In an embodiment, test profile also comprises the position of open source software project, tested software developing instrument and test script.
Test profile is used to describe in detail the institutional framework of test program set, the position that comprises open source software project, tested software developing instrument and test script, and the registration table of open source software project, and one group of default playback control option, whether the control option of for example resetting comprises chained library file when carrying out chained command.
The registration table of open source software project, be used for depositing all open source software projects of test set＜title, the position〉right, the playback driver module is known open source software project and the position thereof that will use by scanning this registration table.
Command line parameter is used to make things convenient for user's Iterim Change when test to reset and controls option, or selects other special test mode, for example incremental testing in the preferred implementation.
In addition, when test environment is set, also need to be redirected output stream the information when redirected output stream is used for hold-over command execution failure according to the needs that generate test log.
Step S220, playback driver module read the alter mode that makes up command stream and configuration, and carry out normalized to making up order.
By reading the buildlog file of storage, obtain the structure order of the open source software project of execution single-step operation successively among the embodiment, form and make up command stream.
Read the delegation's text among the buildlog at every turn.Generally, delegation's text is exactly an order of carrying out single-step operation, directly appends to the tabulation end that representative makes up command stream.
Two kinds of situations are carried out special processing:
Situation one, line of text is with the ending of ' ' character.
This explanation command description is crossed over multiline text, and driver module need continue to read in, and, and each style of writing originally coupled together treats as a whole no longer with ' ' EOC up to line of text.
Situation two contains ’ ﹠amp in the order; ﹠amp; ' or ' || ' connector.
This explanation order is to comprise the interdictum duplex that multistep is operated, and needs should order at the connector place to disconnect, and up to the order that obtains respectively to carry out single-step operation, and adds the structure command stream in regular turn.If the dependence between the structure order that connector is represented is influential to test process, then directly interdictum duplex is added the structure command stream, revise as other type command when configuration makes up the order alter mode by the user.
Step S230, the playback driver module is according to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, the command process standalone module of this open source software project correspondence is imported in every order that will make up command stream successively into, and the running environment parameter is provided.
Step S240, the command process standalone module carries out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
The command process standalone module calls the command process interface of being realized by the user corresponding to the structure command stream, by the alter mode that disposes described structure command stream is converted into test command stream, and the parameter of running environment is write in the test command of test command stream.
Step S300, the command process sharing module is called SDK (Software Development Kit) to be tested and is carried out described test command stream, carries out building process and resets.
Call SDK (Software Development Kit) to be tested and carry out the test command that obtains.
The implementation of test command stream can be regarded the simulation to the project build process as.
Step S400, testing execution module monitoring building process is reset, and test report generation module generates test report according to the monitored results of testing execution module output.
In making up playback procedure, the command process sharing module is monitored in real time to the implementation status of test command, the output test log.
Make up the playback daily record---write down adjusted test command stream;
Error message daily record---the error message that the record test command is carried out;
Test crash daily record---unsanctioned part in the record test procedure;
The source code attribute data that data acquisition daily record---record will be gathered.
Test report generation module is carried out Macro or mass analysis to test log, forms test report.
Test report generation module at first analytical test daily record is set up the text of SDK (Software Development Kit) defect report, then each is made up the failure part of playback procedure, if the explanation of corresponding error message causes by being surveyed the instrument defective by software, the information of the part of then will failing records in the file, the test command that the execution of correspondence is failed is attached to after the failure partial information simultaneously, travel through the failure part that each makes up playback procedure according to this, obtain the SDK (Software Development Kit) defect report at last.
In the embodiment, generate the report of two class testings.
The first kind is the SDK (Software Development Kit) defect report.Know the part that makes up the playback procedure failure by the test crash daily record, corresponding to an assembly or the source file in the open source software project, judge whether it is that defective by the tested software developing instrument causes according to the information in the error message daily record then, inquiring structuring playback daily record simultaneously obtains to carry out the test command of failure.Above information has constituted the context environmental when defective manifests jointly, generates the SDK (Software Development Kit) defect report on this basis, in order to help the developer defective is done debugging targetedly.
The source code of open source software project generally is divided into the assembly of different levels according to tree structure, building process is bottom-up to be finished.Assembly is common one group of source file realizing a certain function, is organized in usually under the same catalogue.Make up playback daily record, error message daily record and test crash daily record and be single daily record, wherein the record to the catalogue change can reflect this process, according to the catalogue change record daily record result is divided into different granularities, can more accurately locatees the corresponding relation between the assembly of the failure part of make up resetting, error message, test command that execution is failed and open source software project.For example there is a part that makes up playback to fail, which error message is test report generation module need inquire about in another error message daily record be that this part failure Times comes out, this just need know which message is to belong to this part, have to set up the way of corresponding relation each other.
Second class is the report of source code analytical test.By collecting the data acquisition daily record, call the statistical study callback interface, form the source code analysis report.
The data acquisition daily record comprises a plurality of journal files, difference according to acquisition target, corresponding one by one with each assembly or source file respectively, be distributed in its residing position, each sub-directory by traversal open source software project gets up the data acquisition log collection of disperseing, and calls the statistical study interface then and handles.
The statistical study callback interface is the spare interface of test report generation module, needs the user at the character of tested software developing instrument and source code attribute to be analyzed, writes code and realizes.
The source code attribute of research open source software project is the closing to reality development activities more, grasps the characteristics that program has in the real world, and for example modal internal memory is revealed approach, perhaps the frequency of utilization of certain class pointer etc.
One preferred embodiment in, the present invention also comprises the execution incremental testing.
The playback of an open source software project build process is accompanied by once complete test, every the order that makes up in the command stream is made amendment in regular turn, be converted to test command by modification, these are revised each playback is identical, therefore repeats and can bring unnecessary computing expense.
In addition, one or more test command that exists the tested software developing instrument of defective can cause making up in the playback procedure is carried out failure, among the present invention these orders is called breakpoint.In the process of the defective of debugging software developing instrument, the test iteration that is used for the verifying and debugging result is each time only paid close attention to the command execution situation at these breakpoint places, after eliminating all breakpoints, reset to verify whether when debugging, introduced other defective, produced new breakpoint by complete building process again.
More than two kinds of situations require between twice open source software project build process reset, to provide a kind of incremental testing mode, each iteration is only carried out the breakpoint of previous iteration.
This method will be from step S100 to S400 once complete structure reset and the test report generative process is called and once tests iteration.
Described step S300 also comprises, building process is reset, and carries out the test command of failure and charges to the breakpoint log file.
In the test iterative process, if certain bar test command is carried out failure, the command process sharing module is charged to this test command in the breakpoint log file (breaklog).
The process of incremental testing mode is as described below.
Step S510, the playback driver module is by reading the breakpoint log file, from the breakpoint log file, obtain the structure order of the open source software project of execution single-step operation successively, form and make up command stream, call the breakpoint execution module, the breakpoint execution module is converted into test command stream according to described alter mode with described structure command stream.
The playback driver module is by reading the breaklog file of storage, from the breaklog file, obtain the structure order of the open source software project of execution single-step operation successively, form and make up command stream, and call the breakpoint execution module, should make up command stream and be converted into test command stream.
This step is carried out according to the described mode of step S220, but replaces the input data of buildlog as the playback driver module with breaklog.
The playback driver module can read in a test command from breaklog at every turn, calls the breakpoint execution module and handles.
Step S520, breakpoint execution module call instruction processing sharing module is carried out described test command and is carried out the building process playback, and command process sharing module monitoring building process is reset.
The command process sharing module is carried out described test command with described in the step S300, and the command process sharing module is carried out the test command that imports into.
Step S530, test report generation module generates test report according to the monitored results of testing execution module output.
The effect of above process interrupt-contact execution module is similar to a kind of special command process standalone module, and difference is not rely on any structure command stream, only handles breakpoint, can reflect the test result of this increment iterative and be used for incremental testing afterwards.
Embodiment
Below by set up the Black-box Testing procedure set that comprises an open source software project on (SuSE) Linux OS is example, illustrates the present invention.
The test set framework comprises progs, modules, three sub-directories of results, is respectively applied for and deposits open source software project, module and daily record.Comprise command process sharing module shared_adapter.py, playback driver module build.py, command process standalone module sendmail_adapter.py, breakpoint execution module inc_adapter.py, test report generation module report.py under the modules, and test profile config.py.Each module uses python (a kind of DYNAMIC PROGRAMMING language of explaining execution) to write, and corresponding respectively to one is the program file of suffix with .py.
Interface specification comprises as lower interface:
Enter_dir: adjust and carry out the catalogue change order that enters particular category.
Exit_dir: adjust and carry out the catalogue change order of withdrawing from current directory.
Compile: adjust and carry out the order that source file is compiled as file destination.
Archive: adjust and carry out the order of the files of creating one group of file.
Link: adjust and carry out the order that file destination is linked as executable file or library file.
Other_cmd: adjust and carry out other order.
The command process sharing module comprises that also one group is the daily record output call back function of prefix with log except that realizing above interface:
Log_cmd: structure simulation daily record is charged in the current instruction that will be performed.
Log_fail:, current place directory path is charged to the test crash daily record if failure is carried out in instruction.
Log_err_cmd:, the increment execution journal is charged in the instruction of carrying out failure if failure is carried out in instruction.
Environmental information when test profile is set test execution by one group of name-value pair and a test procedure registration table, wherein main name-value pair comprises:
BASEDIR=test set root directory.
The storing directory of PROGS_BASEDIR=open source software project.
The storing directory of RESULTS_BASEDIR=test log, breakpoint record and test report.
The storing directory of MODULES_BASEDIR=module.
The path of TARGET_TOOL=tested software developing instrument.
The required argument during operation of SPECIAL_FLAGS=tested software developing instrument.
The test procedure registration table realizes with the dictionary structure in the python language, and each in the dictionary is to the abbreviation of a test procedure of element representation and the source code bag title in test set thereof:
REGTAB＝{
’icecast’:’icecast-2.3.1’，\
’wine’:’wine-0.9.24’，\
}
The abbreviation that the playback driver module is imported in order line according to the user, PROGS_BASEDIR and REGTAB in the query configuration file are connected PROGS_BASEDIR with the source code bag title corresponding with abbreviation, just determined the particular location of test procedure.
The playback driver module is the processing command line parameter at first, and read test environment configurations file is provided with test environment.Utilize the operating system built-in function of python language, wrong output stream is redirected to the error message daily record, the error message when making the command execution failure can record in this daily record:
(errlog, os.O_WRONLY|os.O_CREAT) # creates the error message daily record to err=os.open
Os.dup2 (err, 2) # is redirected to the error message daily record with wrong output stream
Be written into command process standalone module or breakpoint execution module then:
If the test of if not do_inc:# complete then is written into the command process standalone module
processor＝_import_(prog+’_adapter’)
If else:# carries out incremental testing, then be written into the breakpoint execution module
processor＝_import_(’inc_adapter’)
(env, prog), wherein env is a test environment parameter to the initialization of execution module: processor.init then.
To each the bar order among the test procedure buildlog, standalone module: processor.proc (cmd) is handled in call instruction at last.
The user realizes with lower interface according to writing command process standalone module sendmail_adapter.py with reference to realization:
Init is when being written into by the playback driver module, according to the environment configurations parameter initialization module of importing into.
Entrance function when proc is called by the driver module of resetting, the recognition command type is called corresponding Processing Interface.
Enter_dir, exit_dir, compile, archive, link are responsible for the respective type order is divided into command name, parameter and effective object three parts, carry out specific to the adjustment that makes up command stream, and the interface of the same name of sharing module are handled in call instruction.
At last sendmail_adapter.py is deposited under the modules sub-directory.
The breakpoint execution module has the interface identical with the command process standalone module, it is a kind of special command processing module that is independent of any open source software project, treatment mechanism is basic identical, what difference was to handle is trained order in the last test, therefore at first to therefrom filter out SPECIAL_FLAGS, avoid after processing procedure in repeat insertion.
Suppose that the user wishes to create test procedure and carry out test based on mail server open source software project sendmail-2.6.31, as shown in Figure 2.
S201 obtains to make up command stream.
The user places the progs catalogue with the source code bag of sendmail-2.6.31, fill order make clean ﹠amp under sendmail-2.6.31 source code bag; ﹠amp; Make ﹠amp; Buildlog, check buildlog, guarantee the success of program actual implementation.
Step S202 returns buildlog.
Step S203 is provided with running environment.
The user adds sendmail-2.6.31 and is called for short sendmail in the open source software project registration table of test profile.
The playback driver module reads the test profile of storage and makes up the command line parameter of command stream, so that running environment to be set; Described test profile comprises the registration table of open source software project.
Step S204 starts and carries out the building process playback.
Fill order ./build.py-p sendmail starts the playback driver module, wherein-and p parameter nominative testing program name.
Step S205 reads buildlog.
The buildlog that playback driver module read step S201 generates
Step S206, conversion makes up order and is test command.
The playback driver module is according to the sendmail of step S202 registration, the alter mode of inquiry sendmail, and standalone module is handled in call instruction, and will to make up command conversion according to this mode be test command.
Step S207 finishes command conversion and execution.
After finishing command conversion, the call instruction of command process standalone module is handled sharing module to the test command execution of resetting.
Step S208, test command stream is finished.
The command process sharing module is finished behind the test command stream, and execution result is returned to the playback driver module.
Step S209 returns daily record and breakpoint record.
After playback procedure is finished, playback daily record sendmail-build.log appears making up down in the results sub-directory, error message daily record sendmail-err.log, test crash daily record sendmail-fail.log, data acquisition daily record sendmail-data.log and breakpoint record breaklog.
Step S210 generates test report.
The playback driver module sends to test report generation module with test log and breakpoint record.
Step S211 returns instrument defect report or source code analysis report.
Test report generation module reads daily record, obtains reflecting compiler instrument defect report.If generate the source code analysis report, the user need write code, realizes the statistical study interface among the report.py.
Carry out incremental testing as shown in Figure 3.
Step S301 starts and carries out the increment execution.
User's fill order ./build.py-r-p sendmail starts the playback driver module.Wherein-and the test this time of r parameter indicating is an incremental mode, driver module will be written into the breakpoint execution module.
Step S302 reads the breakpoint record.
The playback driver module reads the breakpoint record breaklog of generation.And pass to the breakpoint execution module and handle.
Step S303 handles and carries out breakpoint command.
The playback driver module read will read the breakpoint record pass to the breakpoint execution module and handle.
Step S304 finishes command conversion and execution.
The breakpoint execution module is inquired about the alter mode of sendmail according to the sendmail of registration, and will make up command conversion is test command, and passes to the command process sharing module.
Step S305, test command stream is finished.
The command process sharing module is finished behind the test command stream, and execution result is returned to the playback driver module.
Step S306 returns daily record and new breakpoint record
After playback procedure is finished, playback daily record sendmail-build.log appears making up down in the results sub-directory, error message daily record sendmail-err.log, test crash daily record sendmail-fail.log, data acquisition daily record sendmail-data.log and breakpoint record breaklog.
Step S307 starts the generation test report.
The playback driver module is passed to test report generation module with test log and breakpoint record.
Step S308 returns test report.
Test report comprises instrument defect report or source code analysis report.
Test report generation module reads daily record, obtains reflecting compiler instrument defect report.If generate the source code analysis report, the user need write code, realizes the statistical study interface among the report.py.
The present invention is applied to the development﹠ testing of advanced compilers and process analysis and error detection instrument.Use the present invention, the user can set up and expand the Black-box Testing procedure set fast, combines closely with the actual environment for use of tested software developing instrument, reflects the variation and the demand change of tested software developing instrument in time.The present invention can independently use, and also can be dissolved in other test process.
Be applied to the program's source code analysis.The present invention is by adjusting and simulation project building process, source file in the open source software project is treated as an organic whole, the data acquisition daily record of output is the result after whole procedure is analyzed, can help the user that the characteristic of the program in the real world is carried out statistical study, assist the exploitation of associated subject study and SDK (Software Development Kit).
The test macro of SDK (Software Development Kit) of the present invention as shown in Figure 4.
Test report generation module 300 is used for generating test report according to the monitored results of testing execution module 200 outputs.
In an embodiment, configuration module 100 is further used for for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project; To each open source software project, indicate the alter mode of command name, parameter and/or effective object to each type command.
With specifically be testing execution module in the embodiment structure as shown in Figure 5.
Command process standalone module 220 is used for carrying out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
Command process sharing module 230 is used to call SDK (Software Development Kit) to be tested and carries out described test command stream, carries out building process and resets.
Command process sharing module 230 also is used for the implementation status of test command is monitored in real time, returns test log to playback driver module 210.
In an embodiment, test report generation module 300 is used for the text that the defect report of SDK (Software Development Kit) is set up in the analytical test daily record; Travel through the failure part that each makes up playback procedure, failure part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then the information with described failure part records in the described text, the test command that the execution of correspondence is failed is attached to after the failure partial information simultaneously, obtains the defect report of SDK (Software Development Kit).
One preferred embodiment
The command process sharing module also is used for building process is reset, and the test command of carrying out failure is charged to the breakpoint log file.
The playback driver module also is used for obtaining the structure order of the open source software project of execution single-step operation successively by reading the breakpoint log file from the breakpoint log file, forms and makes up command stream, calls the breakpoint execution module.
The breakpoint execution module is used for according to described alter mode described structure command stream being converted into test command and flows, and call instruction processing sharing module is finished the described test command of execution and carried out building process playback and the playback of monitoring building process.
The institutional framework of the test set of creating in the specific embodiment of the invention as shown in Figure 6, the semanteme of each shape conforms to the component diagram standard of unified modeling language UML among the figure, wherein reset driver module, command processing function interface, command process sharing module, breakpoint execution module, test report generation module by the invention provides, the open source software project is added according to testing requirement by the user, be stored in the configuration module, and, create command process standalone module corresponding to the open source software project by revising the reference realization of command processing function interface.The present invention comprises two main flow processs: resets based on building process and creates and the use test program, and the incremental testing iteration; Shown in accompanying drawing 2 and accompanying drawing 3, the semanteme of each shape conforms to the sequence chart standard of unified modeling language UML among the figure respectively.Wherein the key step based on building process playback establishment and use test program comprises: obtain to make up command stream, customized command processing mode, carry out building process playback and generation test report, the key step of incremental testing iteration comprises to be carried out incremental testing and generates test report.Below by introducing each key step, the effect of each module and interface is described, and two big flow processs are done detailed explanation.
The modification process that makes up command stream is specifically passed through a recognition function e and four adjustment function f d, fc, fl, fo finishes.Wherein e judges command type according to C, P, calls corresponding adjustment function; Fd, fc, fl, fo handle four types order respectively, finish the adjustment to its C, P, O, and carry out adjusted order.The present invention requires the structure command stream of user at the open source software project, and this group function interface is embodied as corresponding command process standalone module.Simultaneously, the present invention will extract the adjustment operation that arbitrary structure command stream all must be carried out, be embodied as the command process sharing module, make that the user only needs to finish the special processing relevant with the particular build command stream in standalone module, call final conversion and execution that sharing module is finished order then.The present invention realizes that for the user provides the reference of command process standalone module the user revises or adds a small amount of code, can finish the establishment of command process standalone module in reference to the portion copy of realizing.
Those skilled in the art can also carry out various modifications to above content under the condition that does not break away from the definite the spirit and scope of the present invention of claims.Therefore scope of the present invention is not limited in above explanation, but determine by the scope of claims.
Claims (12)
1. the method for testing of a SDK (Software Development Kit) is characterized in that, comprising:
Step 1, configuration module obtains and stores the structure order of open source software project, preserves the alter mode to described structure order of configuration;
Step 2, testing execution module read the structure order of storage, revise described structure command stream according to the alter mode of configuration, are converted into test command stream will make up command stream;
Step 3, testing execution module are called SDK (Software Development Kit) to be tested and are carried out described test command stream, carry out building process and reset;
Step 4, testing execution module monitoring building process is reset, and test report generation module generates test report according to the monitored results of testing execution module output.
2. the method for testing of SDK (Software Development Kit) as claimed in claim 1 is characterized in that,
Described step 1 further is,
Step 21, for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project;
Step 22 to each open source software project, indicates the alter mode of command name, parameter and/or effective object to each type command.
3. the method for testing of SDK (Software Development Kit) as claimed in claim 1 is characterized in that,
Described testing execution module comprises playback driver module and command process standalone module;
Described step 2 further is,
Step 31, playback driver module read the test profile of storage and make up the command line parameter of command stream, and so that running environment to be set, described test profile comprises the registration table of open source software project;
Step 32, playback driver module read the alter mode that makes up command stream and configuration, and carry out normalized to making up order;
Step 33, the playback driver module is according to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, the command process standalone module of described open source software project correspondence is imported in every order that will make up command stream successively into, and the running environment parameter is provided;
Step 34, described command process standalone module carries out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
4. the method for testing of SDK (Software Development Kit) as claimed in claim 3 is characterized in that,
Described testing execution module also comprises the command process sharing module,
Described step 3 is further called SDK (Software Development Kit) to be tested for the command process sharing module and is carried out described test command stream, carries out building process and resets.
5. the method for testing of SDK (Software Development Kit) as claimed in claim 1 is characterized in that,
Described step 4 further is,
Step 51, testing execution module is monitored in real time to the implementation status of test command, the output test log
Step 52, the text of the defect report of SDK (Software Development Kit) is set up in the daily record of test report generation module analytical test;
Step 53, test report generation module travels through each failure part that makes up playback procedure, failure part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then the information with described failure part records in the described text, and the test command that the execution of correspondence is failed is attached to after the failure partial information simultaneously, obtains the defect report of SDK (Software Development Kit).
6. the method for testing of SDK (Software Development Kit) as claimed in claim 3 is characterized in that,
Described step 3 also comprises, building process is reset, and the test command of carrying out failure is charged to the breakpoint log file;
After executing at least once test, carry out following incremental testing process,
Step 61, the playback driver module is by reading the breakpoint log file, from the breakpoint log file, obtain the structure order of the open source software project of execution single-step operation successively, form and make up command stream, call the breakpoint execution module, the breakpoint execution module is converted into test command stream according to described alter mode with described structure command stream;
Step 62, breakpoint execution module call instruction processing sharing module are carried out described test command and are carried out the building process playback, and the monitoring building process is reset;
Step 63, test report generation module generates test report according to the monitored results of testing execution module output.
7. the test macro of a SDK (Software Development Kit) is characterized in that, comprising:
Configuration module is used to obtain and store the structure order of open source software project, preserves the alter mode to described structure order of configuration;
Testing execution module is used to read the structure order of storage, revises described structure command stream according to the alter mode of configuration, is converted into test command and flows will make up command stream; Call SDK (Software Development Kit) to be tested and carry out described test command stream, carry out building process and reset; The monitoring building process is reset;
Test report generation module is used for generating test report according to the monitored results of testing execution module output.
8. the test macro of SDK (Software Development Kit) as claimed in claim 7 is characterized in that,
Described configuration module is further used for for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project; To each open source software project, indicate the alter mode of command name, parameter and/or effective object to each type command.
9. the test macro of SDK (Software Development Kit) as claimed in claim 7 is characterized in that,
Described testing execution module comprises playback driver module and command process standalone module;
The playback driver module, the command line parameter that is used to read the test profile of storage and makes up command stream, so that running environment to be set, described test profile comprises the registration table of open source software project; Read the alter mode that makes up command stream and configuration, and carry out normalized making up order; According to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, the command process standalone module of described open source software project correspondence is imported in every order that will make up command stream successively into, and the running environment parameter is provided;
The command process standalone module is used for carrying out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
10. the test macro of SDK (Software Development Kit) as claimed in claim 9 is characterized in that,
Described testing execution module also comprises the command process sharing module,
The command process sharing module is used to call SDK (Software Development Kit) to be tested and carries out described test command stream, carries out building process and resets.
11. the test macro of SDK (Software Development Kit) as claimed in claim 10 is characterized in that,
The command process sharing module also is used for the implementation status of test command is monitored in real time, returns test log to the playback driver module;
The playback driver module also is used to export described test log;
Test report generation module is used for the text that the defect report of SDK (Software Development Kit) is set up in the analytical test daily record; Travel through the failure part that each makes up playback procedure, failure part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then the information with described failure part records in the described text, the test command that the execution of correspondence is failed is attached to after the failure partial information simultaneously, obtains the defect report of SDK (Software Development Kit).
12. the test macro of SDK (Software Development Kit) as claimed in claim 9 is characterized in that,
The command process sharing module also is used for building process is reset, and the test command of carrying out failure is charged to the breakpoint log file;
The playback driver module also is used for obtaining the structure order of the open source software project of execution single-step operation successively by reading the breakpoint log file from the breakpoint log file, forms and makes up command stream, calls the breakpoint execution module;
The breakpoint execution module is used for according to described alter mode described structure command stream being converted into test command and flows, and call instruction processing sharing module is finished the described test command of execution and carried out building process playback and the playback of monitoring building process.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010204249 CN101866315B (en) | 2010-06-11 | 2010-06-11 | Test method and system of software development tool |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010204249 CN101866315B (en) | 2010-06-11 | 2010-06-11 | Test method and system of software development tool |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101866315A true CN101866315A (en) | 2010-10-20 |
| CN101866315B CN101866315B (en) | 2013-01-02 |
Family
ID=42958047
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010204249 Active CN101866315B (en) | 2010-06-11 | 2010-06-11 | Test method and system of software development tool |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101866315B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567164A (en) * | 2011-12-23 | 2012-07-11 | 中国科学院自动化研究所 | Instruction set batch testing device and method for processor |
| CN103052943A (en) * | 2010-09-09 | 2013-04-17 | 株式会社日立制作所 | Source code conversion method and source code conversion program |
| CN103220163A (en) * | 2012-01-19 | 2013-07-24 | 阿里巴巴集团控股有限公司 | Updating method and system of configuring information |
| CN106297242A (en) * | 2016-08-26 | 2017-01-04 | 美的智慧家居科技有限公司 | The method and apparatus controlling home appliance |
| CN108920377A (en) * | 2018-07-16 | 2018-11-30 | 杭州安恒信息技术股份有限公司 | A kind of log playback test method, system, device and readable storage medium storing program for executing |
| CN109240932A (en) * | 2018-09-21 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of test method, device and the equipment of unified storage management software |
| CN109871312A (en) * | 2017-12-05 | 2019-06-11 | 航天信息股份有限公司 | A kind of interface test method, device, equipment and readable storage medium storing program for executing |
| CN112363729A (en) * | 2020-11-23 | 2021-02-12 | 北京轩宇信息技术有限公司 | Monitoring method and device for multi-compiler hybrid compilation for static analysis |
| US11455237B2 (en) | 2020-06-01 | 2022-09-27 | Agora Lab, Inc. | Highly scalable system and method for automated SDK testing |
| US20230350671A1 (en) * | 2021-05-04 | 2023-11-02 | Sdt Inc. | Method for replicating a project server for trouble-shooting and a cloud development platform system using the same |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5805795A (en) * | 1996-01-05 | 1998-09-08 | Sun Microsystems, Inc. | Method and computer program product for generating a computer program product test that includes an optimized set of computer program product test cases, and method for selecting same |
| US20040153837A1 (en) * | 2002-09-13 | 2004-08-05 | International Business Machines Corporation | Automated testing |
| CN1971535A (en) * | 2005-11-21 | 2007-05-30 | 中国科学院软件研究所 | Testing method and system of safety input output automation based on time |
-
2010
- 2010-06-11 CN CN 201010204249 patent/CN101866315B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5805795A (en) * | 1996-01-05 | 1998-09-08 | Sun Microsystems, Inc. | Method and computer program product for generating a computer program product test that includes an optimized set of computer program product test cases, and method for selecting same |
| US20040153837A1 (en) * | 2002-09-13 | 2004-08-05 | International Business Machines Corporation | Automated testing |
| CN1971535A (en) * | 2005-11-21 | 2007-05-30 | 中国科学院软件研究所 | Testing method and system of safety input output automation based on time |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103052943A (en) * | 2010-09-09 | 2013-04-17 | 株式会社日立制作所 | Source code conversion method and source code conversion program |
| CN102567164A (en) * | 2011-12-23 | 2012-07-11 | 中国科学院自动化研究所 | Instruction set batch testing device and method for processor |
| CN103220163A (en) * | 2012-01-19 | 2013-07-24 | 阿里巴巴集团控股有限公司 | Updating method and system of configuring information |
| CN103220163B (en) * | 2012-01-19 | 2017-03-01 | 阿里巴巴集团控股有限公司 | The update method of configuration information and system |
| CN106297242A (en) * | 2016-08-26 | 2017-01-04 | 美的智慧家居科技有限公司 | The method and apparatus controlling home appliance |
| CN109871312B (en) * | 2017-12-05 | 2022-08-12 | 航天信息股份有限公司 | Interface testing method, device, equipment and readable storage medium |
| CN109871312A (en) * | 2017-12-05 | 2019-06-11 | 航天信息股份有限公司 | A kind of interface test method, device, equipment and readable storage medium storing program for executing |
| CN108920377A (en) * | 2018-07-16 | 2018-11-30 | 杭州安恒信息技术股份有限公司 | A kind of log playback test method, system, device and readable storage medium storing program for executing |
| CN109240932A (en) * | 2018-09-21 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of test method, device and the equipment of unified storage management software |
| US11455237B2 (en) | 2020-06-01 | 2022-09-27 | Agora Lab, Inc. | Highly scalable system and method for automated SDK testing |
| US11650913B2 (en) | 2020-06-01 | 2023-05-16 | Agora Lab, Inc. | Highly scalable system for automated SDK testing |
| CN112363729A (en) * | 2020-11-23 | 2021-02-12 | 北京轩宇信息技术有限公司 | Monitoring method and device for multi-compiler hybrid compilation for static analysis |
| US20230350671A1 (en) * | 2021-05-04 | 2023-11-02 | Sdt Inc. | Method for replicating a project server for trouble-shooting and a cloud development platform system using the same |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101866315B (en) | 2013-01-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101866315B (en) | Test method and system of software development tool | |
| US11789715B2 (en) | Systems and methods for transformation of reporting schema | |
| Raghothaman et al. | SWIM: synthesizing what I mean: code search and idiomatic snippet synthesis | |
| US7716254B2 (en) | System for modeling architecture for business systems and methods thereof | |
| US8930884B2 (en) | Efficient extraction of software dependencies from program code | |
| Miles et al. | Prime: A methodology for developing provenance-aware applications | |
| US7334219B2 (en) | Method and system for object level software testing | |
| US6922827B2 (en) | Iterative software development environment with prioritized build rules | |
| Kazman et al. | Architecture reconstruction guidelines | |
| CN111832236B (en) | Chip regression testing method and system, electronic equipment and storage medium | |
| EP3491527B1 (en) | Debugging tool for a jit compiler | |
| US9524366B1 (en) | Annotations to identify objects in design generated by high level synthesis (HLS) | |
| US20200097260A1 (en) | Software application developer tools platform | |
| US7603388B2 (en) | Representing file data using virtual hierarchy | |
| CN114356964A (en) | Data blood margin construction method and device, storage medium and electronic equipment | |
| US20210072961A1 (en) | Automated generation of software bindings | |
| Washizaki et al. | ProMeTA: a taxonomy for program metamodels in program reverse engineering | |
| Tatale et al. | A Survey on Test Case Generation using UML Diagrams and Feasibility Study to Generate Combinatorial Logic Oriented Test Cases. | |
| Drago et al. | QVTR2: A Rational and Performance-Aware Extension to the Relations Language. | |
| Joshi et al. | Automatic generation of fault trees from AADL models | |
| Demsky et al. | Automatic extraction of heap reference properties in object-oriented programs | |
| Beg | Translating from" State-Rich" to" State Poor" Process Algebras | |
| Hartmanns et al. | Fast Verified SCCs for Probabilistic Model Checking | |
| JP2005158030A (en) | Program code automatic generation method, apparatus, and computer readable medium | |
| CN117707499A (en) | Multi-source model algorithm analyzer plug-in and compiling algorithm based on virtualization technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |