WO2016109914A1

WO2016109914A1 - Gesture based card game man-machine interaction method and system

Info

Publication number: WO2016109914A1
Application number: PCT/CN2015/070079
Authority: WO
Inventors: 周谆
Original assignee: 周谆
Priority date: 2015-01-05
Filing date: 2015-01-05
Publication date: 2016-07-14

Abstract

A gesture based card game man-machine interaction method and system, for achieving a real experience when playing a card game by using devices such as a computer and a game console. The method comprises: receiving hand depth information obtained by a depth sensor in a perception space thereof; analyzing a motion of the hand according to the hand depth information; obtaining a gesture corresponding to the motion of the hand according to the motion of the hand; and finally, on the basis of the gesture, controlling whether to deal in the card game. The hand of a game participant is located within the perception space of the depth sensor; when "hit me" or "stand" is required to be indicated to the computer or the game console, switching the gestures to indicate the intention to the computer or the game console as participating in a real-person game; the depth sensor acquires the hand depth information and feeds back the same to a master control system of the computer or the game console; and the master control system analyzes the gesture of the game participant, thus enabling real game experience of the game participant.

Description

Gesture-based card game human-computer interaction method and system

Technical field

The present invention relates to the field of virtual reality technologies, and in particular, to a gesture-based card game human-computer interaction method and system.

Background technique

Card games are one of the popular entertainment methods. They are usually played with one or more decks of cards. Each deck consists of four suits and a total of 52 cards.

There are a variety of card games, including Blackjack's card game, which is played by 2 to more people. The first to join the game is the dealer, and the rest is the player. The goal of the game is to make the number of cards in the player's hand. The sum does not exceed 21 points and is as large as possible; among them, each playing card has points, the number of playing cards of 2 to 10 is the number of its cards, and the number of points of J, Q and K is 10, A has two algorithms. , 1 or 11, if the total number is greater than 21 when A is 11, then A is counted as 1. During the game, the dealer or the player decides whether to "hit me" or "stand" according to the total number of cards in his hand.

If the game is played between real people, the player can use the gesture to communicate with the dealer, but the real game needs to be carried out under the conditions of meeting the venue and the participants; and the intelligent game devices such as computers and game consoles have the simulation 21 Point games, computers, game consoles as a bookmaker, players are playing games with computers or game consoles, especially after computer networking, many players can participate in the game through the network, so that players can get games similar to real-life dealers in the game. Experience. During the game, the player needs to indicate whether it is “to be a card” or “discontinued” to the computer or the game machine through physical button or touch screen touch. This way of interacting with the computer and the game machine is different from that of the real person. The game process makes the game participants feel less realistic.

Summary of the invention

The object of the present invention is to provide a gesture-based card game human-computer interaction method and system, which realizes the technical effect of real feeling when playing card games with a computer, a game machine or the like.

The object of the invention is achieved by the following technical solutions:

A gesture-based card game human-computer interaction method is proposed, which comprises the steps of: receiving hand depth information acquired by a depth sensor in a sensing space thereof; and analyzing hand motion according to the hand depth information; a motion corresponding to the hand motion, and generating a gesture corresponding to the gesture based on the gesture, the human-computer interaction command controlling whether a card is dealt in the card game; The hand depth information includes palm depth information and depth information of each finger.

Further, the analyzing the motion of the hand according to the hand depth information, specifically: obtaining the three-dimensional coordinates and speed information of the hand based on the hand depth information; according to the three-dimensional coordinates of the hand And analyzing the displacement of the hand; and analyzing the movement direction of the hand according to the speed information of the hand.

Further, if the control is dealt in the card game, the gesture corresponds to the up and down movement or the reciprocating up and down movement of the palm in the depth sensor sensing space.

Further, if the control is dealt in the card game, the gesture corresponds to the up and down movement or the reciprocating up and down movement of the finger in the depth sensor sensing space.

Further, if the control does not issue a card in the card game, the gesture corresponds to a left-right movement or a reciprocating left-right movement of the palm in the depth sensor sensing space.

Further, if the control does not issue a card in the card game, the gesture corresponds to a left-right movement or a reciprocating left-right movement of the finger in the depth sensor sensing space.

Further, if the control is dealt in the card game, the method further includes: Randomly draw a card deal in one or more pairs of cards.

Further, before the randomly drawing a card deal in one or more pairs of cards, the method further comprises: establishing and importing a card model.

Further, the process of the card game is displayed on a display interface.

Further, the method further includes: obtaining feature information of the hand based on the hand depth information; determining whether the feature information of the hand changes; if yes, performing a hand motion corresponding gesture after the change Human-computer interaction instructions; wherein the feature information includes bone information of the palm and each finger; the bone information includes a width and/or a length of the bone.

A gesture-based card game human-computer interaction system is proposed, the system comprising: a depth sensor for acquiring hand depth information in a sensing space thereof; a master control system, configured to receive the hand acquired by the depth sensor The depth information is used to analyze the motion of the hand according to the hand depth information; and according to the motion of the hand, the gesture corresponding to the hand motion is obtained; and based on the gesture, the human machine corresponding to the gesture is generated. An interactive instruction that controls whether a card is dealt in the card game; wherein the hand depth information includes palm depth information and depth information of each finger.

Further, the master control system analyzes the motion of the hand according to the hand depth information, specifically: obtaining three-dimensional coordinates and speed information of the hand based on the hand depth information; The three-dimensional coordinates are analyzed, and the displacement of the hand is analyzed; and the direction of movement of the hand is analyzed according to the speed information of the hand.

Further, if the master control system controls the card to be dealt in the card game, the gesture corresponds to the up and down movement of the palm in the sensing space of the depth sensor or toward Move up and down.

Further, if the main control system controls the card to be dealt in the card game, the gesture corresponds to the up and down movement or the reciprocating up and down movement of the finger in the sensing space of the depth sensor.

Further, if the master control system does not issue a card in the card game, the gesture corresponds to a left-right motion or a reciprocating left-right motion of the palm in the depth sensor sensing space.

Further, if the master control system does not issue a card in the card game, the gesture corresponds to a left-right motion or a reciprocating left-right motion of the finger in the depth sensor sensing space.

Further, if the master control system controls the card to be dealt in the card game, the master control system is further configured to: randomly draw a card deal in one or more pairs of cards.

Further, the system further includes a building unit for establishing a card model, the master control system constructing from the card before the random card is dealt in one or more pairs of cards The unit imports the card model.

Further, the system further includes a display unit for displaying the process of the card game on its display interface.

Further, the main control system is further configured to: obtain feature information of the hand based on the hand depth information; determine whether the feature information of the hand changes; if yes, perform no change after the hand The human-computer interaction instruction corresponding to the gesture; wherein the feature information includes bone information of the palm and each finger; and the skeleton information includes a width and/or a length of the bone.

The beneficial effects or advantages of the technical solution provided by the present invention are: in the process of playing a card game with a device such as a computer or a game machine, the hand of the game participant is located in the sensing space of the depth sensor, when the game participant needs to go to the computer, the game When the machine (banker) indicates "to card" or "suspend", it can indicate the intention to the computer or the game machine by changing the gesture as in the real game, and the depth sensor collects the hand depth information in the sensing space, and The hand depth information is fed back to the main control system of the computer or the game machine, and the main control system of the computer or the game machine analyzes the gestures of the game participants according to the depth information, and determines whether the game participants need to “require cards” or Need to "suspend", so that the game participants can continue to deal or stop the card, this game process, making the game participants like playing in the real estate dealer, the experience is real.

DRAWINGS

1 is a flowchart of a gesture-based card game human-computer interaction method according to an embodiment of the present application;

2 is a schematic diagram of a depth sensor sensing space according to an embodiment of the present application;

FIG. 3 is a schematic diagram of a “required card” according to an embodiment of the present application;

4 is a schematic diagram of a “required card” proposed in an embodiment of the present application;

FIG. 5 is a schematic diagram of “suspension of cards” according to an embodiment of the present application;

FIG. 6 is a flowchart of still another gesture-based card game human-computer interaction method according to an embodiment of the present application;

FIG. 7 is a system block diagram of a gesture-based card game human-computer interaction system according to an embodiment of the present application.

detailed description

The technical solutions provided by the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

In the embodiment of the present application, the player's hand is located in the sensing space of the depth sensor, and when the game participant (usually the player) makes a gesture action like a real person game, the depth is deep. The degree sensor collects the hand depth information of the game participant, and transmits the hand depth information to the main control system of the computer, the game machine or the like, and the main control system determines the corresponding gesture according to the hand depth information, thereby Understand the player's intent, perform a deal or stop the deal, making the game participants feel real.

The gesture-based card game human-computer interaction method proposed in the embodiment of the present application, as shown in FIG. 1 , includes the following steps:

Step S11: Receive hand depth information acquired by the depth sensor in its perceptual space.

The depth information of the hand (including the palm and each finger) is obtained by a depth sensor disposed around a smart game device such as a computer or a game machine; the current depth sensor can acquire the hand, including the palm and each finger. The spatial three-dimensional coordinates and velocity information, for example, kinect sensor, which can acquire the information of the hand at a frequency of several tens of frames per second, and the LeapMotion sensor can be acquired at a frequency of more than one hundred frames per second.

As shown in FIG. 2, the depth sensor 1 is placed on the front end of the display interface 21 of a device such as a computer or a game machine. The sensible range is formed in front of the display interface (directly in front of the game participant) to form a palm-like and The sensing space of each finger, when the game participant performs the hand operation in the sensing space, the palm and each finger position and speed information can be perceived by the depth sensor. Of course, in the case where the depth sensor is wirelessly connected to a device such as a computer or a game machine, the depth sensor is not necessarily limited to being placed around the device such as a computer or a game machine, but is placed according to the spatial position of the actual hand operation, without having to make it The hand is limited to a fixed position for gesture operation.

Step S12: Analyze the movement of the hand according to the hand depth information.

The depth sensor acquires spatial three-dimensional coordinates and velocity information of the palm and each finger in three-dimensional space, and the speed information includes a speed and a speed direction;

A specific embodiment is to obtain the three-dimensional coordinates of the hand based on the hand depth information. And speed information; and according to the three-dimensional coordinates of the hand, analyze the displacement of the hand, and analyze the direction of movement of the hand according to the speed information of the hand.

The depth sensor collects the depth information of the hand in the sensing space. Therefore, the three-dimensional coordinates in the acquired depth information form the motion displacement of the hand on the time axis, and the speed direction and the velocity in the velocity information are in the space. The direction of movement and speed of movement of the hand are constructed.

Step S13: obtaining a gesture corresponding to the hand movement according to the movement of the hand;

Step S14: Based on the gesture, generate a human-computer interaction instruction corresponding to the gesture, and the human-computer interaction instruction controls whether the card is dealt in the card game.

Based on the movement of the hand, the gesture corresponding to the hand movement can be calculated; specifically, combined with the movement displacement of the hand and the movement direction and the movement speed, a gesture model of the hand occurring in the space can be constructed, and different gesture models correspond to different gestures. The human-computer interaction instruction, for example, the gesture of moving up and down corresponds to the card, and the gesture of the left and right motion corresponds to the suspension, and the correspondence between the specific gesture and the human-computer interaction instruction can be determined according to the actual situation of the game, and the solution is not limited.

In a specific embodiment, as shown in FIG. 3 and FIG. 4, if the control is to deal in a card game, the gesture corresponds to the up and down movement or the reciprocating up and down movement of the palm in the depth sensor sensing space, including the natural extension of the finger or a condition in which some of the fingers are naturally extended (shown in FIG. 3); or, the up and down movement of the finger in the sensing space of the depth sensor or the reciprocating up and down movement (shown in FIG. 4, the index finger is shown); the gesture shown in FIG. It also includes the following cases: when the finger is naturally extended or a part of the finger is naturally extended, the extended finger moves up and down in the sensing space of the depth sensor or reciprocates up and down.

In another specific embodiment, as shown in FIG. 5, if the control does not issue a card in the card game, the gesture corresponds to the left and right motion or the reciprocating left and right motion of the palm in the depth sensor sensing space, including the natural extension of the finger or a condition in which some of the fingers are naturally extended; or, the fingers are The depth sensor senses the left and right motion or the reciprocating left and right motion in the space, including the left and right movement or the reciprocating left and right movement of the extended finger in the sensing space of the depth sensor when the finger is naturally extended or a part of the finger is naturally extended.

In the embodiment of the present application, if the control is dealt in the card game, the method further includes the step S15: randomly extracting one card deal in one or more pairs of cards. Before the licensing, you need to create and import a card model; if the game is running on a computer or a game console, you can create a 2D model or a 3D model of the card based on the actual display and display it if the game is played with a computer or In the three-dimensional virtual space outside the game machine, it is necessary to construct a three-dimensional model of the card and display it.

In an actual blackjack card game, a device such as a computer or a game machine continues to comprehensively determine the total number of points of the game participant or the dealer (self or other player) after performing the card deal or suspension of the game, and compares the game participation. Compare the scores with the dealer's points.

The progress of the game usually improves the realism of the game through the display of the display interface. For the computer or game machine, the display interface is the display screen of the computer or the game machine; the depth sensor is usually placed around the display interface, but the actual situation It is not limited to this, as long as the player's hand depth information can be sensed, and the collected hand depth information can be transmitted to the main control system of a computer or a game machine, etc., and the device such as a computer or a game machine. The master control system interconnects the hand depth information by wired or wireless means.

In addition to completing the execution and control of the card game, as shown in FIG. 6, the main control system may further perform step S51: obtaining feature information of the hand based on the hand depth information; the feature information includes bone information of the palm and each finger, and the skeleton information Including the width and/or length of the bone, etc., specifically, through the depth information of the palm and each finger, through identification and calculation, the width and length of the bone of the palm and each finger are obtained.

Step S52: determining whether the feature information of the hand changes; if the depth sensor senses The hand in the knowledge space has changed and is no longer the hand of the game participant. After the depth information of the changed hand is collected by the depth sensor, the human-computer interaction operation based on the depth information may be The game process produces misoperations that affect the progress of the game. Therefore, using a certain frequency comparison process, the current hand feature information is compared with the last obtained hand feature information. If there is no change, the game participant is still participating in the game normally, and if there is a change, the steps are S53: The human-computer interaction instruction corresponding to the gesture of the hand movement after the change is not executed.

The embodiment of the present application further provides a gesture-based card game human-computer interaction system, as shown in FIG. 7, including a depth sensor 1 and a main control system 61; the main control system is usually a control system of the game running system, such as a computer main Control system, game console or master control system. The main control system is configured to receive the hand depth information acquired by the depth sensor, analyze the movement of the hand according to the hand depth information, and obtain a gesture corresponding to the hand motion according to the movement of the hand; and generate a gesture corresponding to the gesture based on the gesture The human-computer interaction instruction controls whether the card is dealt in the card game; wherein the hand depth information includes the palm depth information and the depth information of each finger.

A specific implementation manner is: obtaining three-dimensional coordinates and speed information of the hand based on the hand depth information; analyzing the displacement of the hand according to the three-dimensional coordinates of the hand, and analyzing the movement of the hand according to the speed information of the hand direction.

If the master control system determines that it is necessary to control the card game in the card game according to the gesture of the game participant, the gesture corresponds to the up and down movement of the palm or the finger in the depth sensor sensing space or the up and down reciprocation; if the master control system is based on the game participant's The gesture judgment needs to control the stop of the card in the card game, and the gesture corresponds to the left and right motion or the left and right reciprocating motion of the palm or the finger in the depth sensor sensing space.

If the master control system controls the card deal in the card game, a card deal is randomly drawn from one or more decks of cards.

Correspondingly, the above system further comprises a building unit 62; the building unit is configured to establish a card model, and the master control system imports the card model from the building unit before randomly drawing a card in one or more pairs of cards, and The cards are displayed in a card game.

Correspondingly, the above system further comprises a display unit 63 for displaying the process of the card game on its display interface.

The main control system is further configured to obtain feature information of the hand based on the hand depth information; and determine whether the feature information of the hand changes; if yes, the human-computer interaction command corresponding to the hand motion after the change is not executed. The feature information includes bone information of the palm and each finger; the bone information includes the width and/or length of the bone.

The working process of the specific system has been detailed in the above-mentioned gesture-based card game human-computer interaction method, and will not be described here.

In the gesture-based card game human-computer interaction method and system proposed by the embodiments of the present application, in the process of playing a card game such as a blackjack game, such as a game participant and a computer, the game does not need to be operated by a button or a touch interface. Rather, it uses the same operational gestures as real-life games with real people to indicate whether the smart game device such as a computer wants to be "carded" or "discontinued", realizing a real sense of experience when playing card games with smart game devices such as computers and game consoles. Technical effects.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer programs are available Having a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that instructions executed by a processor of a computer or other programmable data processing device are generated for implementation in a flowchart A process or a plurality of processes and/or a block diagram of a device in a box or a plurality of functions specified in a plurality of blocks.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims

A gesture-based card game human-computer interaction method, comprising the steps of:

Receiving hand depth information acquired by the depth sensor in its perceptual space;

Analyze the movement of the hand according to the hand depth information;

Obtaining a gesture corresponding to the hand movement according to the movement of the hand;

And generating, according to the gesture, a human-computer interaction instruction corresponding to the gesture, where the human-computer interaction instruction controls whether a card is dealt in the card game;

The hand depth information includes palm depth information and depth information of each finger.
The gesture-based card game human-computer interaction method according to claim 1, wherein the analyzing the movement of the hand according to the hand depth information is specifically:

Obtaining three-dimensional coordinates and speed information of the hand based on the hand depth information;

Analyzing the displacement of the hand according to the three-dimensional coordinates of the hand;

The direction of motion of the hand is analyzed based on the speed information of the hand.
The gesture-based card game human-computer interaction method according to claim 1, wherein if the control is dealt in the card game, the gesture corresponds to the palm being in the depth sensor sensing space. Move up and down or back and forth.
The gesture-based card game human-computer interaction method according to claim 1, wherein if the card is controlled to be dealt in the card game, the gesture corresponds to the up and down movement of the finger in the depth sensor sensing space. Or reciprocating up and down.
The gesture-based card game human-computer interaction method according to claim 1, wherein if the control does not issue a card in the card game, the gesture corresponds to a palm Left and right motion or reciprocating left and right motion in the depth sensor sensing space.
The gesture-based card game human-computer interaction method according to claim 1, wherein if the control does not issue a card in the card game, the gesture corresponds to a finger in the depth sensor sensing space Exercise or reciprocating left and right movements.
The gesture-based card game human-computer interaction method according to claim 1, wherein if the control is dealt in the card game, the method further comprises:

Randomly draw a card deal in one or more pairs of cards.
The gesture-based card game human-computer interaction method according to claim 7, wherein before the one or more pairs of cards are randomly selected to draw a card, the method further comprises:

Create and import a card model.
The gesture-based card game human-computer interaction method according to claim 1, wherein the process of the card game is displayed on a display interface.
The gesture-based card game human-computer interaction method according to claim 1, wherein the method further comprises:

Obtaining feature information of the hand based on the hand depth information;

Determining whether the feature information of the hand changes;

If so, the human-computer interaction command corresponding to the gesture of the hand movement after the change is not executed.

Wherein, the feature information includes bone information of the palm and each finger; and the bone information includes a width and/or a length of the bone.
A gesture-based card game human-computer interaction system, characterized in that the system comprises:

a depth sensor for acquiring hand depth information in its perceptual space;

a master control system, configured to receive the hand depth information acquired by the depth sensor, analyze motion of the hand according to the hand depth information; and obtain the hand motion corresponding according to the motion of the hand And generating, according to the gesture, a human-computer interaction instruction corresponding to the gesture, the human-computer interaction instruction controlling whether a card is dealt in the card game;

The hand depth information includes palm depth information and depth information of each finger.
The gesture-based card game human-computer interaction system according to claim 11, wherein the main control system analyzes the movement of the hand according to the hand depth information, specifically:

Obtaining three-dimensional coordinates and speed information of the hand based on the hand depth information;

Analyzing the displacement of the hand according to the three-dimensional coordinates of the hand;

The direction of motion of the hand is analyzed based on the speed information of the hand.
The gesture-based card game human-computer interaction system according to claim 11, wherein if the master control system controls the card to be dealt in the card game, the gesture corresponds to the palm at the depth The sensor senses up and down motion or reciprocating up and down motion within the space.
The gesture-based card game human-computer interaction system according to claim 11, wherein if the master control system controls the card to be dealt in the card game, the gesture corresponds to the finger sensing at the depth sensor Up and down movements in the space or reciprocating up and down movements.
The gesture-based card game human-computer interaction system according to claim 11, wherein if the master control system controls not to issue a card in the card game, The gesture corresponds to a left-right movement or a reciprocating left-right movement of the palm in the sensing space of the depth sensor.
The gesture-based card game human-computer interaction system according to claim 11, wherein if the main control system controls not to deal in the card game, the gesture corresponds to a finger at the depth sensor Perceive the left and right motion or the reciprocating left and right motion in the space.
The gesture-based card game human-computer interaction system according to claim 11, wherein if the master control system controls the card to be dealt in the card game, the master control system is further configured to:

Randomly draw a card deal in one or more pairs of cards.
The gesture-based card game human-computer interaction system according to claim 17, wherein the system further comprises a building unit, the building unit is configured to establish a card model, and the master control system is in the random The card model is imported from the building unit before the card is dealt in a pair or a plurality of cards.
The gesture-based card game human-computer interaction system according to claim 11, wherein the system further comprises a display unit for displaying the process of the card game on its display interface.
The gesture-based card game human-computer interaction system according to claim 11, wherein the main control system is further configured to:

Obtaining feature information of the hand based on the hand depth information;

Determining whether the feature information of the hand changes;

If yes, the human-computer interaction instruction corresponding to the gesture of the hand movement after the change is not executed;

Wherein, the feature information includes bone information of the palm and each finger; and the bone information includes a width and/or a length of the bone.